-- Logs begin at Mon 2022-07-18 14:14:42 UTC, end at Mon 2022-07-18 15:32:50 UTC. -- Jul 18 15:03:53.153701 dv-cinder-836973-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 15:03:53.164523 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 15:03:53 2022] *** Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: nodename: dv-cinder-836973-13-iscsi Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: machine: x86_64 Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: clock source: unix Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: pcre jit disabled Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: detected number of CPU cores: 4 Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: current working directory: / Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: detected binary path: /usr/bin/uwsgi-core Jul 18 15:03:53.166668 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: your processes number limit is 47680 Jul 18 15:03:53.167449 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: your memory page size is 4096 bytes Jul 18 15:03:53.167449 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: detected max file descriptor number: 2048 Jul 18 15:03:53.167449 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: lock engine: pthread robust mutexes Jul 18 15:03:53.167449 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: thunder lock: enabled Jul 18 15:03:53.167449 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 15:03:53.167449 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 15:03:53.208476 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: Python main interpreter initialized at 0x55a832bfe9c0 Jul 18 15:03:53.208476 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: python threads support enabled Jul 18 15:03:53.208476 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: your server socket listen backlog is limited to 100 connections Jul 18 15:03:53.208476 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: your mercy for graceful operations on workers is 90 seconds Jul 18 15:03:53.208878 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 15:03:53.208878 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: *** Operational MODE: preforking *** Jul 18 15:03:53.209109 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: *** uWSGI is running in multiple interpreter mode *** Jul 18 15:03:53.209109 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: spawned uWSGI master process (pid: 103791) Jul 18 15:03:53.209344 dv-cinder-836973-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 15:03:53.210935 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: spawned uWSGI worker 1 (pid: 103792, cores: 1) Jul 18 15:03:53.210935 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: spawned uWSGI worker 2 (pid: 103793, cores: 1) Jul 18 15:03:53.210935 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 15:03:53.909607 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 15:03:53.910274 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 15:03:55.024547 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:03:55.024547 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: from cryptography.utils import int_from_bytes Jul 18 15:03:55.025369 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:03:55.025369 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: from cryptography.utils import int_from_bytes Jul 18 15:03:55.032465 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:03:55.032465 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: from cryptography.utils import int_from_bytes Jul 18 15:03:55.033004 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:03:55.033004 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: from cryptography.utils import int_from_bytes Jul 18 15:03:57.561642 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 15:03:57.562262 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 15:03:57.562512 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 15:03:57.562906 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 15:03:57.563166 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 15:03:57.563557 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.563883 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.564208 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.564533 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.564869 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.565179 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.565502 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.565821 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.566152 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.566414 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.566775 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.567107 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-13-iscsi {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.567433 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.567743 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.568057 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.568377 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.568682 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.569009 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.569319 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.569828 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.569997 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 15:03:57.570417 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 15:03:57.570551 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.570551 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.570806 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 15:03:57.570924 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.571050 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 15:03:57.571207 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.571445 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 15:03:57.571563 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.571656 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.571822 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.571999 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.572142 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.572293 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.572430 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.572569 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.572751 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.573062 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.573208 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.573436 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.573585 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-13-iscsi {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.573805 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.573946 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574069 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574207 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574328 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574460 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574632 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574809 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.574954 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-13-iscsi {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.575141 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.575305 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.575447 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.575595 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.575740 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.575862 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576111 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576258 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576403 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576544 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576811 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.576980 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.577172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.577510 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.577676 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.577909 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.578222 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.578359 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.578569 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.578723 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.578859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.579006 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.579192 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.579329 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.579501 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.579661 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.579873 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580013 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580156 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580291 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580423 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580564 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580699 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580840 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.580984 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581119 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581288 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581430 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-13-iscsi {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581573 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581715 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581850 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.581994 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.582128 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.582271 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.582479 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.582704 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.582846 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583020 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583158 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583310 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583452 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583620 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583759 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.583930 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584078 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584213 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584352 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584531 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584839 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.584997 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.585162 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.585302 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.585478 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.585615 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.585779 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.585926 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.586067 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.586201 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.586379 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.586518 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.586725 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.586877 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587013 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587158 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587444 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587587 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587721 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.587855 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588006 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588142 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588276 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588451 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588598 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588772 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.588912 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.589051 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.589210 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.589357 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.589521 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.589675 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.589845 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590055 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590204 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590338 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590471 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590626 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590783 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.590929 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591077 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591211 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591353 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591498 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591641 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591774 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.591934 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.592070 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.592210 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.592361 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.592505 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.593198 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.593375 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.593513 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.593721 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.593960 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.594098 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.594329 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.594475 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.594688 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.594825 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.594959 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.595102 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.595250 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.595385 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.595554 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.595744 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.595886 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596036 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596221 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596361 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596508 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596643 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596785 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.596925 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597070 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597204 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597343 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597484 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597652 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597801 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.597961 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.598101 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.598270 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.598409 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.598616 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.598759 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.598906 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599041 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599186 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599327 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599470 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599685 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599830 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.599972 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.600239 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.600378 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.600511 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.600654 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.600791 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.600923 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601068 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601212 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601346 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601489 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601634 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601769 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.601909 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.602044 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.602183 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.602336 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.602479 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.602641 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.602789 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.603175 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.603325 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.603461 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.603594 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.603733 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.603887 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604056 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604201 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604344 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604479 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604613 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604746 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.604880 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605023 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605164 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605432 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605602 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605751 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.605894 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606030 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606216 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606355 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606499 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606702 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606850 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.606987 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.607130 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.607272 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.607416 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.607551 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.607698 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.607902 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.608050 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.608222 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.609000 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.609394 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.609557 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.609694 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.609885 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.610022 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.610248 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.610575 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.610744 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.610889 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.611024 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.611165 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.611165 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.611428 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.611570 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.611704 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.611837 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.611982 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.612117 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.612265 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.612400 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.612541 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.612675 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.612821 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.612965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.613100 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.613240 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.613392 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.613540 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.613675 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.613816 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.613950 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.614084 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.614216 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.614358 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.614605 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.614770 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.614906 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.615072 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.615224 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.615352 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:03:57.615515 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.615671 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.615868 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616009 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616190 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616355 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616500 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616644 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616837 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.616985 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.617150 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.617287 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.617466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.617600 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.617792 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.617928 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.618081 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.618230 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.618404 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.618571 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.618738 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.618862 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619050 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619176 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619363 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619500 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619677 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619810 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.619990 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.620130 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.620372 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.620522 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.620657 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.620792 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.620939 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.621081 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.621231 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.621374 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.621521 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.621657 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.621814 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.622043 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.622189 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.622325 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.622459 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.622792 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.622792 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623062 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623185 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623297 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623437 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623582 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623725 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.623922 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.624081 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.624220 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.624356 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.624669 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.624820 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625160 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625317 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625454 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625589 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625723 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625862 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.625997 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.626131 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.626265 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.626436 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.626596 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.626757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.626895 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.627110 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.627251 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.627422 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.627561 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.627734 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.627881 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628025 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628160 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628337 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628489 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628633 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628774 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.628961 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.629101 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.629270 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.629420 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.629585 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.629723 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.629893 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.630031 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.630201 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.630350 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.630629 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.630769 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.630904 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631080 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631214 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631364 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631500 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631633 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631767 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.631937 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632098 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632250 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632387 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632520 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632661 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632796 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.632938 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633072 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633207 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633340 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633473 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633606 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633785 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.633926 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.634091 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.634238 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.634399 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.634580 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.634741 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.634878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635011 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635145 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635313 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635453 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635621 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635761 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.635928 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.636066 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.636231 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.636379 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.636553 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.636693 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.636861 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637000 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637149 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637295 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637463 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637601 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637763 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.637902 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638045 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638221 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638373 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638508 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638708 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638845 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.638985 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.639130 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.639265 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.639399 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.639582 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.639769 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.639949 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.640096 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.640296 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.640498 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.640727 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.640865 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641045 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641183 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641318 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641451 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641585 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641742 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.641896 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.642065 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.642212 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.642407 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.642572 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.642747 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.642898 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643073 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643212 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643390 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643529 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643663 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643809 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.643967 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.644106 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.644270 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.644409 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.644558 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.644703 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.644863 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645005 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645181 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645323 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645482 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645618 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645775 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.645914 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.646097 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.646244 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.646436 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.646636 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.646774 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.646921 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.647092 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.647233 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.647405 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.647551 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.647722 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.647861 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648033 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648180 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648344 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648482 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648657 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648795 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.648969 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.649116 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.649290 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.649469 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.649607 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.649741 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.649904 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.650054 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.650215 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.650352 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.650525 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.650703 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.650910 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651137 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651282 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651415 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651546 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651818 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.651959 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652101 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652234 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652373 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652506 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652651 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652785 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.652924 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653065 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653210 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653343 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653532 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653671 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653833 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.653980 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.654147 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.654285 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.654484 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.654667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.654814 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.654949 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.655627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.655777 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.656186 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.656325 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.656601 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.656736 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.656928 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.657082 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.657259 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.657397 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.657570 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.657710 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.657880 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658015 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658188 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658501 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658661 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658845 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.658999 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.659169 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.659306 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.659477 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.659601 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.659800 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.659948 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.660115 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.660254 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.660421 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.660560 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.660713 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.660856 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661090 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661229 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661362 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661498 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661642 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661784 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.661927 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.662062 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.662203 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.662346 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.662619 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.662763 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.662897 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663030 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663163 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663297 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663480 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663622 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663777 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.663925 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.664156 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.664359 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.664546 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.664682 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.664816 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.664948 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665089 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665266 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665413 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665549 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665683 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665825 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.665961 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.666145 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.666282 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.666424 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.666595 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.666749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.666886 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667029 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667164 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667440 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667575 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667718 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.667867 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668012 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668148 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668316 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668456 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668623 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668772 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.668948 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.669090 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.669256 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.669396 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.669576 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.669844 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.669985 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.670179 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.670326 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.670495 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.670686 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.671528 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.671782 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.672009 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.672152 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.672343 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.672493 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.672683 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.672822 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673007 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673144 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673321 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673460 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673639 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673788 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.673950 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.674099 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.674274 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.674424 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.674621 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.674759 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.674893 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.675194 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.675335 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.675485 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.675622 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.675756 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.675890 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676031 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676166 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676310 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676445 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676579 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676713 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676846 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.676979 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.677126 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.677267 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.677409 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.677545 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.677678 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.677852 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.678002 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.678169 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.678320 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.678478 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.678639 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.678864 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.679120 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.679278 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.679414 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.679547 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.679713 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.679867 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.680003 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.680137 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.680355 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.680502 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.680668 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.680828 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.681007 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.681144 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.681335 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.681483 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.681675 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.681885 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682042 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682178 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682312 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682445 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682640 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682791 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.682927 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683062 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683195 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683328 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683495 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683650 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683794 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.683929 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.684103 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.684241 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.684410 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.684559 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.684724 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.684863 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685037 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685192 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685391 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685539 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685709 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685847 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.685980 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.686113 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.686263 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.686452 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.686611 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.686789 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.686938 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.687258 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.687418 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.687563 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.687703 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.687839 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.687973 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.688151 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.688301 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.688446 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.688589 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.688757 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.688899 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.689071 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.689220 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.689379 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.689519 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.689698 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.689840 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690006 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690155 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690313 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690452 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690658 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690813 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.690962 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.691098 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.691272 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.691415 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.691562 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.691698 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.691878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692019 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692189 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692328 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692495 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692635 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692801 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.692941 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.693100 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.693238 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.693406 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.693553 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.693694 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.693836 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694012 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694150 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694330 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694481 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694690 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694800 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.694971 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695093 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695272 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695393 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695587 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695695 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695884 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.695991 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.696189 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.696311 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.696516 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.696620 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.696809 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.696972 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.697123 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.697247 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.697411 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.697506 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.697717 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.697817 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698024 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698118 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698351 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698453 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698681 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698777 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.698987 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.699083 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.699291 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.699386 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.699595 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.699700 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.699903 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700001 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700205 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700308 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700529 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700637 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700839 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.700940 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.701162 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.701283 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.701484 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.701589 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.701814 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.701907 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.702162 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.702262 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.702483 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.702754 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.702850 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.703132 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.703224 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.703462 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.703571 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.703780 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.703873 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.704102 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.704193 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.704395 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.704512 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.704692 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.704793 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705019 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705118 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705321 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705494 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705617 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705696 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.705922 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.706027 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.706229 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.706347 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.706603 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.706719 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.706900 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707018 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707212 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707314 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707525 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707626 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707836 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.707935 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.708148 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.708249 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.708454 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.708548 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.708759 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.708851 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.709071 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.709162 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.709386 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.709478 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.709700 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.709792 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710011 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710105 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710322 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710421 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710657 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710752 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.710966 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711066 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711275 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711368 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711586 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711686 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711886 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.711981 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.712195 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.712287 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.712499 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.712598 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.712806 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.712898 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.713106 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.713197 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.713433 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.713540 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.713752 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.713852 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.714060 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.714161 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.714371 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.714482 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.714718 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.714814 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715040 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715133 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715355 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715460 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715674 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715812 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.715981 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.716074 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.716288 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.716402 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.716596 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.716716 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.716903 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.717031 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.717211 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.717344 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.717518 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.718191 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.718664 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.718863 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.718978 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.719253 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.719347 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.719570 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.719664 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.719881 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.719990 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.720189 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.720281 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.720496 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.720587 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.720805 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.720899 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.721108 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.721201 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.721431 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.721523 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.721738 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.721840 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722041 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722133 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722350 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722546 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722660 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722876 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.722968 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.723189 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.723281 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.723550 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.723674 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.723878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.723969 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.724206 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.724299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.724517 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.724611 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.724842 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.724966 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.725157 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.725261 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.725467 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.725578 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.725781 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.725909 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.726094 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.726202 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.726407 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.726505 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.726753 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.726874 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.727083 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.727184 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.727412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.727510 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.727713 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.727817 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.728264 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.728376 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.728572 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.728672 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.728893 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.728993 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.729193 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.729308 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.729501 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.729612 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.729790 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.729954 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.730110 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.730264 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.730441 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.730573 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.730745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.730842 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.731154 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.731257 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.731461 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.731574 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.731765 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.731878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.732085 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.732196 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.732398 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.732513 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.732712 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.732816 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.733023 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.733126 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.733401 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.734119 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.734264 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.734689 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.734799 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.735062 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.735170 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.735380 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.735476 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.735693 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.735788 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736022 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736140 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736349 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736444 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736655 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736755 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.736969 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.737078 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.737289 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.737386 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.737623 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.737775 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.737927 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.738062 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.738226 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.738366 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.738565 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.738706 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.738899 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.739039 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.739225 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.739373 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.739559 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.739699 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.739922 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740072 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740216 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740359 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740495 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740628 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740819 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.740959 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.741093 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.741324 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.741468 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.741613 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.741749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.741884 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742018 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742213 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742356 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742502 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742669 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742806 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.742940 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743075 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743222 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743369 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743510 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743644 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743778 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.743912 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744047 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744195 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744331 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744630 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744777 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.744922 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745056 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745230 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745371 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745549 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745692 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745836 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.745971 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.746194 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.746335 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.746480 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.746776 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.746962 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747099 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747234 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747369 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747505 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747639 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747782 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.747918 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748052 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748185 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748328 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748506 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748652 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748787 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.748959 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.749097 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.749299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.749510 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.749836 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.749982 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.750158 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.750301 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.750480 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.750658 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.750828 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.750968 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.751149 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.751296 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.751431 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.751573 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.751719 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.751835 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752036 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752161 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752339 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752489 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752624 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752760 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.752930 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.753071 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.753238 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.753540 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.753704 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.753875 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754019 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754163 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754380 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754519 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754704 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754843 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.754979 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755113 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755261 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755411 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755547 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755689 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755824 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.755969 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.756105 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.756323 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.756462 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.756596 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.756738 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.756883 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757019 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757161 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757285 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757441 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757580 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757761 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.757902 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.758087 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.758226 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.758393 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.758574 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.758740 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.758893 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759039 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759174 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759353 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759502 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759674 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759813 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.759946 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.760081 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.760265 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.760406 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.760578 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.760721 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.760890 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761030 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761243 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761390 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761525 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761667 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761802 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.761936 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.762085 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.762222 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.762509 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.762666 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.762847 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.762988 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.763167 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.763307 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.763485 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.763813 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.764153 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.764537 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.765011 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.765510 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.765674 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.765843 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.766381 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.766728 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.767057 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.767199 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.767390 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.767528 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.767723 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.767874 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.768048 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.768197 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.768372 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.768524 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.768695 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.768842 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769006 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769144 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769315 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769455 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769631 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769780 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.769947 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.770087 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.770256 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.770404 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.770617 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.770760 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.770935 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771088 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771231 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771422 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771571 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771708 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771841 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.771976 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.772231 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.772385 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.772529 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.772724 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.772864 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.773049 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.773189 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.773381 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.773522 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.773713 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.773862 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774035 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774184 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774349 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774488 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774699 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774845 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.774981 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.775126 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.775285 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.775425 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.775602 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.775742 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.775917 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.776065 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.776230 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.776378 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.776600 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.776747 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.776885 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777029 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777164 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777441 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777576 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777720 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.777855 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.778029 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.778287 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.778426 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.778627 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.778788 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.778972 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.779114 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.779280 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.779419 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.779597 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.779746 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.779906 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.780046 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.780767 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.780919 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.781070 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.781386 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.781525 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.781706 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.781854 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782017 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782152 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782333 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782474 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782818 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.782996 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.783156 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.783300 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.783445 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.783603 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.783753 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.783938 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.784087 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.784261 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.784402 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.784573 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.784712 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.784878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.785111 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.785260 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.785468 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.785615 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.785793 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.785947 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.786115 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.786254 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.786430 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.786589 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.786796 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.786948 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.787085 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.787216 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.787390 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.787645 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.787794 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.787991 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.788131 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.788310 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.788449 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.788625 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.788765 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.788934 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.789075 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.789242 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.789381 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.789562 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.789711 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.789872 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790010 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790178 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790316 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790492 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790679 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790825 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.790927 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.791137 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.791232 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.791444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.791559 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.791753 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.791846 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792059 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792153 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792370 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792474 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792677 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792770 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.792987 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.793140 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.793362 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.793499 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.793647 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.793781 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.793916 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794048 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794191 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794325 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794562 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794715 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794853 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.794988 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.795133 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.795276 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.795400 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.795532 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.795667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.796476 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.796627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.796741 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.796975 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.797167 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.797380 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.797558 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.797709 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.797873 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.798020 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.798198 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.798336 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.798515 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.798711 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.798869 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.799008 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.799191 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.799344 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.799513 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.799689 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.799868 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.800007 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.800189 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.800342 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.800627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.800764 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.800943 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.801083 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.801272 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.801419 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.801600 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.801739 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.801917 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.802066 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.802244 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.802393 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.802577 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.802717 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.802914 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.803051 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.803241 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.803381 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.803553 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.803699 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.803865 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804005 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804176 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804327 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804470 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804602 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804777 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.804924 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805068 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805202 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805380 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805523 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805689 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805837 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.805979 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.806112 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.806286 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.806424 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.806613 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.806765 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.806922 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807156 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807298 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807432 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807576 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807726 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807851 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.807984 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.808118 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.808286 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.808436 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.808608 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.808756 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.808924 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809073 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809239 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809390 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809553 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809692 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809856 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.809993 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.810163 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.810310 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.810447 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.810602 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.810785 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.810926 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.811092 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.811241 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.811416 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.811565 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.811928 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.812084 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.812230 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.812498 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.812638 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.812820 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.812959 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.813144 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.813298 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.813471 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.813611 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.813785 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.813925 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.814096 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.814243 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.814424 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.814611 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.814764 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.814909 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.815059 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.815194 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.815375 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.815513 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.815708 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.815847 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816020 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816158 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816335 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816474 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816651 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816792 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.816969 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.817126 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.817340 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.817477 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.817610 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.817744 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.817890 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818034 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818175 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818310 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818443 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818618 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818756 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.818904 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819070 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819210 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819387 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819535 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819692 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819831 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.819999 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.820137 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.820303 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.820453 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.820588 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.820720 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.820899 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821045 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821187 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821321 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821488 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821626 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821797 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.821940 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.822087 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.822221 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.822402 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.822603 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.822741 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.822874 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823090 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823226 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823359 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823491 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823623 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823762 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.823910 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824053 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824194 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824328 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824460 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824656 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824795 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.824986 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.825125 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.825340 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.825486 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.825657 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.825795 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.826005 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.826144 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.826337 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.826476 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.826681 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.826821 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.827619 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.827816 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.827962 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.828088 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.828232 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 15:03:57.828529 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.828853 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.829192 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.829506 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.829825 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.830141 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.830452 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.830789 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.831945 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.831945 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.831945 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.832398 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.832398 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.832780 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.832951 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.833311 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.833575 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.833901 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.834210 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.834521 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.834850 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.835159 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.835467 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.835780 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.836086 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.836394 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.836708 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.837085 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.837347 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.837716 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.837975 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.838299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.838647 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.838996 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.839307 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.839656 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.839986 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.840299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.840609 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.840914 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:03:57.841181 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 15:03:57.891472 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Registered counter for database nova_api Jul 18 15:03:57.906901 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO dbcounter [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Registered counter for database nova_api Jul 18 15:03:58.005622 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.012392 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.023295 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_db.sqlalchemy.engines [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.029823 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writer thread running {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.069467 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.context [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac9e3721-a803-4db4-873c-e4d171be63cf(cell1) {{(pid=103792) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 15:03:58.073425 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:03:58.075009 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:03:58.075824 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:03:58.078011 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:03:58.080113 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Registered counter for database nova_cell0 Jul 18 15:03:58.084057 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Registered counter for database nova_cell1 Jul 18 15:03:58.088695 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.context [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac9e3721-a803-4db4-873c-e4d171be63cf(cell1) {{(pid=103793) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 15:03:58.091799 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.093005 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:03:58.093915 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.095052 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:03:58.095890 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:03:58.098068 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:03:58.099451 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.100179 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO dbcounter [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Registered counter for database nova_cell0 Jul 18 15:03:58.102083 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.104509 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO dbcounter [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Registered counter for database nova_cell1 Jul 18 15:03:58.112954 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_db.sqlalchemy.engines [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.114326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_db.sqlalchemy.engines [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.120845 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writer thread running {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.122895 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writer thread running {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.250715 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Registered counter for database nova_cell0 Jul 18 15:03:58.260116 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.265741 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.273036 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO dbcounter [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Registered counter for database nova_cell0 Jul 18 15:03:58.283349 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_db.sqlalchemy.engines [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:03:58.289464 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writer thread running {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:03:58.701632 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:03:58.705507 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: WARNING keystonemiddleware.auth_token [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:03:58.711116 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:03:58.713347 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: WARNING keystonemiddleware.auth_token [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:03:59.069014 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: WARNING keystonemiddleware.auth_token [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:03:59.075041 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: WARNING keystonemiddleware.auth_token [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:03:59.079626 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:03:59.080345 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a832bfe9c0 pid: 103793 (default app) Jul 18 15:03:59.082450 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:03:59.083682 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 Jul 18 15:03:59.084102 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Mon Jul 18 15:03:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:03:59.086029 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-76eac7dd-2d2e-4a5e-abd5-327fd8de6bbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:03:59.091940 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a832bfe9c0 pid: 103792 (default app) Jul 18 15:05:22.667568 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:22.669419 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Jul 18 15:05:22.671488 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 2/2] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:22.691013 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=3 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:22.692668 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell0:SELECT=3 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:22.693878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell1:SELECT=3 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:22.694726 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:23.716228 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-0bc2995a-358f-411d-9432-46b53fec7dab admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:23.750171 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-0bc2995a-358f-411d-9432-46b53fec7dab admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.070715 Jul 18 15:05:23.761184 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 1/3] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Jul 18 15:05:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:26.204299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:26.205591 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-5731d793-0a5b-49bd-bda9-42965c9aacdd None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Jul 18 15:05:26.205992 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 3/4] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:26.699981 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e40f2df1-663a-4af6-bf7e-0d204e5b9ef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:26.718389 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:05:26.718389 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 18 15:05:26.798133 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e40f2df1-663a-4af6-bf7e-0d204e5b9ef5 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.583900 Jul 18 15:05:26.799709 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 2/5] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 15:05:26.813870 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_api:SELECT=3 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:26.815448 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_cell0:SELECT=3 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:26.816170 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_cell1:SELECT=3 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:26.817283 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:27.022946 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-e0dbe071-a85b-4fc1-a607-7a57893148a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:27.026227 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:05:27.026227 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: warnings.warn(msg) Jul 18 15:05:27.146054 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-e0dbe071-a85b-4fc1-a607-7a57893148a9 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338128 Jul 18 15:05:27.147328 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 4/6] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Jul 18 15:05:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:05:29.504255 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e40f2df1-663a-4af6-bf7e-0d204e5b9ef5 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:29.505295 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e40f2df1-663a-4af6-bf7e-0d204e5b9ef5 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 18 15:05:29.505902 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 3/7] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:30.248647 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-65e1afe1-d462-4e42-82b0-c10d30192deb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:30.266299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:05:30.266299 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: warnings.warn(msg) Jul 18 15:05:30.378788 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-65e1afe1-d462-4e42-82b0-c10d30192deb admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.865628 Jul 18 15:05:30.379582 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 5/8] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:30.393060 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1f04d592-dcac-4cdc-84a4-7bd7e416d1c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:30.394619 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:05:30.394619 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 18 15:05:30.490324 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1f04d592-dcac-4cdc-84a4-7bd7e416d1c9 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101190 Jul 18 15:05:30.499310 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 4/9] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Jul 18 15:05:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:32.933688 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-65e1afe1-d462-4e42-82b0-c10d30192deb admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:32.933688 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-65e1afe1-d462-4e42-82b0-c10d30192deb admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Jul 18 15:05:32.936346 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 6/10] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:33.349902 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1dcc1b67-ec5e-4a7d-9310-1ae6452f8706 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "swap": 0}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:33.536963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1dcc1b67-ec5e-4a7d-9310-1ae6452f8706 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.595553 Jul 18 15:05:33.537524 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 5/11] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:33.550203 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-ae0c1872-e21e-4998-94fc-bd44feb6d188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:33.648342 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-ae0c1872-e21e-4998-94fc-bd44feb6d188 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101684 Jul 18 15:05:33.648830 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 7/12] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Jul 18 15:05:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:35.934477 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1dcc1b67-ec5e-4a7d-9310-1ae6452f8706 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:35.935686 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1dcc1b67-ec5e-4a7d-9310-1ae6452f8706 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Jul 18 15:05:35.936201 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 6/13] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:36.397633 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-25d923b8-e724-42f0-ab3b-3a2907c2c22a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:36.456953 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-25d923b8-e724-42f0-ab3b-3a2907c2c22a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514556 Jul 18 15:05:36.457665 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 8/14] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:36.472713 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-721e28d9-e98a-49f6-bb0f-cc4a03e7a5fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:36.546759 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-721e28d9-e98a-49f6-bb0f-cc4a03e7a5fb admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077670 Jul 18 15:05:36.547475 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 7/15] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Jul 18 15:05:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:38.967381 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-25d923b8-e724-42f0-ab3b-3a2907c2c22a admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:38.968392 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-25d923b8-e724-42f0-ab3b-3a2907c2c22a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 18 15:05:38.968799 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 9/16] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:39.431129 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1e67f804-f069-4565-8d49-1df37e58ddf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "id": "d4", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:39.511374 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1e67f804-f069-4565-8d49-1df37e58ddf2 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536387 Jul 18 15:05:39.511955 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 8/17] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:39.529359 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-dde7bee9-ee0f-4c9a-8103-21444fae86ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:39.627606 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-dde7bee9-ee0f-4c9a-8103-21444fae86ed admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106207 Jul 18 15:05:39.628616 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 10/18] 10.222.0.83 () {64 vars in 1335 bytes} [Mon Jul 18 15:05:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:42.002588 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1e67f804-f069-4565-8d49-1df37e58ddf2 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:42.003549 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1e67f804-f069-4565-8d49-1df37e58ddf2 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 18 15:05:42.003956 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 9/19] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:42.465054 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-86e5a8b5-009a-4e3b-a203-388b9a7d0d28 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:42.491085 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-86e5a8b5-009a-4e3b-a203-388b9a7d0d28 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479983 Jul 18 15:05:42.491670 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 11/20] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Jul 18 15:05:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:05:44.772754 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1e67f804-f069-4565-8d49-1df37e58ddf2 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:44.775353 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1e67f804-f069-4565-8d49-1df37e58ddf2 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001902 Jul 18 15:05:44.775891 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 10/21] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:45.222837 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-abd59f66-c428-4a12-a9c1-8be8fd7b9ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:45.293973 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-abd59f66-c428-4a12-a9c1-8be8fd7b9ff6 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.510677 Jul 18 15:05:45.294666 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 12/22] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:45.308693 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-8a33cbae-f756-428f-a577-1815f4a6e0c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:45.381462 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-8a33cbae-f756-428f-a577-1815f4a6e0c2 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077845 Jul 18 15:05:45.382170 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 11/23] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Jul 18 15:05:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:47.697076 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-abd59f66-c428-4a12-a9c1-8be8fd7b9ff6 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:47.698106 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-abd59f66-c428-4a12-a9c1-8be8fd7b9ff6 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 18 15:05:47.698513 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:05:48.132025 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-8e53209d-d067-4554-8284-80975167c9d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:48.205242 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-8e53209d-d067-4554-8284-80975167c9d0 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500595 Jul 18 15:05:48.205801 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 12/25] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:48.217819 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-fe838cf8-032a-476f-ad38-f1e6ec151763 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:48.298462 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-fe838cf8-032a-476f-ad38-f1e6ec151763 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084305 Jul 18 15:05:48.299428 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 14/26] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Jul 18 15:05:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:50.667454 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-8e53209d-d067-4554-8284-80975167c9d0 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:50.668462 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-8e53209d-d067-4554-8284-80975167c9d0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 18 15:05:50.668879 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 13/27] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:51.056461 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-cca696b4-e39c-4908-91ed-03b3d4a8caca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:51.135240 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-cca696b4-e39c-4908-91ed-03b3d4a8caca admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.460226 Jul 18 15:05:51.135800 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 15/28] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 15:05:51.147782 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-f6b37334-84e3-4ea2-a81f-a48c76730ce7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:51.219670 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-f6b37334-84e3-4ea2-a81f-a48c76730ce7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075605 Jul 18 15:05:51.220256 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 14/29] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Jul 18 15:05:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:53.706994 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-cca696b4-e39c-4908-91ed-03b3d4a8caca admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:53.708004 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-cca696b4-e39c-4908-91ed-03b3d4a8caca admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 18 15:05:53.708451 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 16/30] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:54.202130 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-133f8c4e-c978-460c-849b-29ded7df2c54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "4", "disk": 80}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:54.207290 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:05:54.296733 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-133f8c4e-c978-460c-849b-29ded7df2c54 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.581606 Jul 18 15:05:54.304868 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 15/31] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:54.312667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-136c4f37-522b-43fc-872f-79805ad46054 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:54.402044 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-136c4f37-522b-43fc-872f-79805ad46054 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095763 Jul 18 15:05:54.403431 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 17/32] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Jul 18 15:05:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:05:56.685600 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-133f8c4e-c978-460c-849b-29ded7df2c54 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:05:56.686774 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-133f8c4e-c978-460c-849b-29ded7df2c54 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jul 18 15:05:56.687699 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 16/33] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:05:57.164339 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-15dbfc5e-49f2-47d4-ad41-3a2d3fec0754 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:57.228150 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-15dbfc5e-49f2-47d4-ad41-3a2d3fec0754 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.534649 Jul 18 15:05:57.229207 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 18/34] 10.222.0.83 () {64 vars in 1282 bytes} [Mon Jul 18 15:05:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:05:57.241220 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-5738dcee-d21c-43c1-8b3d-f0fe043c8ccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:05:57.321870 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-5738dcee-d21c-43c1-8b3d-f0fe043c8ccd admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084333 Jul 18 15:05:57.322450 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 17/35] 10.222.0.83 () {64 vars in 1332 bytes} [Mon Jul 18 15:05:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:06:18.766967 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-15dbfc5e-49f2-47d4-ad41-3a2d3fec0754 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:18.767988 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-15dbfc5e-49f2-47d4-ad41-3a2d3fec0754 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 18 15:06:18.768939 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 19/36] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:19.176183 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-43db8237-2b9b-46e5-936d-911fe1971a9c admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:19.194960 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-43db8237-2b9b-46e5-936d-911fe1971a9c admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418021 Jul 18 15:06:19.195403 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Jul 18 15:06:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:20.316497 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-15dbfc5e-49f2-47d4-ad41-3a2d3fec0754 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:20.317501 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-15dbfc5e-49f2-47d4-ad41-3a2d3fec0754 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 18 15:06:20.317905 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 20/38] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:20.871680 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-7f19a353-5a57-41ff-9211-a48a39b56cd7 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:20.877366 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.wsgi [None req-7f19a353-5a57-41ff-9211-a48a39b56cd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-7f19a353-5a57-41ff-9211-a48a39b56cd7 admin admin] Request method failure captured: Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Accept: application/json Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Accept-Encoding: gzip, deflate Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Connection: keep-alive Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Content-Length: 0 Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Host: 10.222.0.83 Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Openstack-Api-Version: compute 2.90 Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Openstack-System-Scope: None Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: User-Agent: python-novaclient Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Auth-Token: gAAAAABi1XbsCOCW3wZQ0JUAObHYWj7wXW9N8psFB21s6Ynhjjri91-gK_lXJ7wXm8maNhotZ1Lgl115QKjfO1Qq_-uXuMqRZ6J457fLqcI6uTPxpYjl5q1nSpuDV1BT7yfuY6gpvyLvaBr-_0aVB1LKvPEulR-Rz6HUIOvmhoPo04LWp3hJSPg Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Domain-Id: None Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Domain-Name: None Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Identity-Status: Confirmed Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Is-Admin-Project: True Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Domain-Id: default Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Domain-Name: Default Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Name: admin Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Role: reader,admin,member Jul 18 15:06:20.880544 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Roles: reader,admin,member Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8015bf50f271424ca62c239a2df319f8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant: admin Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant-Name: admin Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User: admin Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Domain-Id: default Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Domain-Name: Default Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Id: baf04811d48d4c3fa638546a709d7179 Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Name: admin Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: method: > Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: exception: Flavor 42 could not be found. Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: action_args: {'id': '42'} Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:06:20.882963 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:20.883952 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.885259 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-7f19a353-5a57-41ff-9211-a48a39b56cd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:06:20.886654 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-7f19a353-5a57-41ff-9211-a48a39b56cd7 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.420241 Jul 18 15:06:20.886654 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 19/39] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Jul 18 15:06:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 15:06:20.893079 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-95b9047f-cdfa-4edb-9716-321edbbb1ac0 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:20.896081 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:06:20.915422 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-95b9047f-cdfa-4edb-9716-321edbbb1ac0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025904 Jul 18 15:06:20.915985 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 21/40] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Jul 18 15:06:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:20.928888 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-a1d7e03c-0275-4c5d-91fc-b5ee44d7589f admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:20.951177 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-a1d7e03c-0275-4c5d-91fc-b5ee44d7589f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028324 Jul 18 15:06:20.951743 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Jul 18 15:06:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:20.961691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-e45097e1-3500-476e-93a4-1604eb7b193e admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:20.967602 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.wsgi [None req-e45097e1-3500-476e-93a4-1604eb7b193e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-e45097e1-3500-476e-93a4-1604eb7b193e admin admin] Request method failure captured: Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Accept: application/json Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Accept-Encoding: gzip, deflate Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Connection: keep-alive Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Content-Length: 0 Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Host: 10.222.0.83 Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Openstack-Api-Version: compute 2.90 Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Openstack-System-Scope: None Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: User-Agent: python-novaclient Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Auth-Token: gAAAAABi1XbsCOCW3wZQ0JUAObHYWj7wXW9N8psFB21s6Ynhjjri91-gK_lXJ7wXm8maNhotZ1Lgl115QKjfO1Qq_-uXuMqRZ6J457fLqcI6uTPxpYjl5q1nSpuDV1BT7yfuY6gpvyLvaBr-_0aVB1LKvPEulR-Rz6HUIOvmhoPo04LWp3hJSPg Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Domain-Id: None Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Domain-Name: None Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Identity-Status: Confirmed Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Is-Admin-Project: True Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Domain-Id: default Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Domain-Name: Default Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Name: admin Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Role: reader,admin,member Jul 18 15:06:20.970965 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Roles: reader,admin,member Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8015bf50f271424ca62c239a2df319f8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant: admin Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant-Name: admin Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User: admin Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Domain-Id: default Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Domain-Name: Default Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Id: baf04811d48d4c3fa638546a709d7179 Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Name: admin Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: method: > Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: exception: Flavor 42 could not be found. Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: action_args: {'id': '42'} Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:06:20.977757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:20.978667 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:20.979749 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-e45097e1-3500-476e-93a4-1604eb7b193e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:06:20.980757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-e45097e1-3500-476e-93a4-1604eb7b193e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014674 Jul 18 15:06:20.980757 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 22/42] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Jul 18 15:06:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 15:06:21.977621 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-a1d7e03c-0275-4c5d-91fc-b5ee44d7589f admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:21.982465 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-a1d7e03c-0275-4c5d-91fc-b5ee44d7589f admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 18 15:06:21.982465 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 21/43] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:22.525827 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-d9ff4f96-212e-4141-bac1-1bf48e65088f admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:22.531242 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.wsgi [None req-d9ff4f96-212e-4141-bac1-1bf48e65088f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-d9ff4f96-212e-4141-bac1-1bf48e65088f admin admin] Request method failure captured: Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Accept: application/json Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Accept-Encoding: gzip, deflate Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Connection: keep-alive Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Content-Length: 0 Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Host: 10.222.0.83 Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Openstack-Api-Version: compute 2.90 Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Openstack-System-Scope: None Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: User-Agent: python-novaclient Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Auth-Token: gAAAAABi1XbtRLGuvz7I_nUF5rFpyycB24srRHjjU-LF03LABTaoUkaf8JS9aFZo6uPoKfx3kh-WoDTPE-Y5rZFqCtplgga3YxIkBMrt4dg4gNqVjgeKlByWvA2r5ipCFphiRvVWdjRydX-c-aFwIoVd-dRFMNiYHX0cmak2VTJ9eu1Zmn_he_M Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Domain-Id: None Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Domain-Name: None Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Identity-Status: Confirmed Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Is-Admin-Project: True Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Domain-Id: default Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Domain-Name: Default Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Name: admin Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Role: reader,admin,member Jul 18 15:06:22.532745 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Roles: reader,admin,member Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8015bf50f271424ca62c239a2df319f8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant: admin Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant-Name: admin Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User: admin Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Domain-Id: default Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Domain-Name: Default Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Id: baf04811d48d4c3fa638546a709d7179 Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Name: admin Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: method: > Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: exception: Flavor 84 could not be found. Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: action_args: {'id': '84'} Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:06:22.534326 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:22.536446 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.538412 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-d9ff4f96-212e-4141-bac1-1bf48e65088f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:06:22.539502 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-d9ff4f96-212e-4141-bac1-1bf48e65088f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412395 Jul 18 15:06:22.539502 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 23/44] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Jul 18 15:06:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 15:06:22.544614 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-73277aca-04e9-43e8-b245-cdcfb74af0de admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:22.559265 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-73277aca-04e9-43e8-b245-cdcfb74af0de admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018211 Jul 18 15:06:22.559817 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 22/45] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Jul 18 15:06:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:22.569975 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-0f83ab77-e1c7-4fc9-8e1e-e539f4796514 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:22.583687 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-0f83ab77-e1c7-4fc9-8e1e-e539f4796514 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017571 Jul 18 15:06:22.586771 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Jul 18 15:06:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:22.596309 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-92f10d64-7c6e-4d47-834c-9d4625eeccdb admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:22.602742 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.wsgi [None req-92f10d64-7c6e-4d47-834c-9d4625eeccdb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-92f10d64-7c6e-4d47-834c-9d4625eeccdb admin admin] Request method failure captured: Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Accept: application/json Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Accept-Encoding: gzip, deflate Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Connection: keep-alive Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Content-Length: 0 Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Host: 10.222.0.83 Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Openstack-Api-Version: compute 2.90 Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Openstack-System-Scope: None Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: User-Agent: python-novaclient Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Auth-Token: gAAAAABi1XbtRLGuvz7I_nUF5rFpyycB24srRHjjU-LF03LABTaoUkaf8JS9aFZo6uPoKfx3kh-WoDTPE-Y5rZFqCtplgga3YxIkBMrt4dg4gNqVjgeKlByWvA2r5ipCFphiRvVWdjRydX-c-aFwIoVd-dRFMNiYHX0cmak2VTJ9eu1Zmn_he_M Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Domain-Id: None Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Domain-Name: None Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Identity-Status: Confirmed Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Is-Admin-Project: True Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Domain-Id: default Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Domain-Name: Default Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Name: admin Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Role: reader,admin,member Jul 18 15:06:22.604246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Roles: reader,admin,member Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8015bf50f271424ca62c239a2df319f8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant: admin Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant-Name: admin Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User: admin Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Domain-Id: default Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Domain-Name: Default Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Id: baf04811d48d4c3fa638546a709d7179 Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Name: admin Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: method: > Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: exception: Flavor 84 could not be found. Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: action_args: {'id': '84'} Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:06:22.605678 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:22.606466 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:22.607627 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-92f10d64-7c6e-4d47-834c-9d4625eeccdb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:06:22.608632 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-92f10d64-7c6e-4d47-834c-9d4625eeccdb admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012860 Jul 18 15:06:22.608632 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 23/47] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Jul 18 15:06:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 15:06:23.597586 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-0f83ab77-e1c7-4fc9-8e1e-e539f4796514 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:23.598614 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-0f83ab77-e1c7-4fc9-8e1e-e539f4796514 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 18 15:06:23.599020 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 25/48] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:24.152752 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-5db7d2b5-9a5c-449c-a63f-13cef7f1458e admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:24.158655 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.wsgi [None req-5db7d2b5-9a5c-449c-a63f-13cef7f1458e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-5db7d2b5-9a5c-449c-a63f-13cef7f1458e admin admin] Request method failure captured: Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Accept: application/json Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Accept-Encoding: gzip, deflate Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Connection: keep-alive Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Content-Length: 0 Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Host: 10.222.0.83 Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Openstack-Api-Version: compute 2.90 Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Openstack-System-Scope: None Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: User-Agent: python-novaclient Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Auth-Token: gAAAAABi1XbvGM_org9jTMS-hQmcfqtm4joA3KKnh-urPJSD7FYe29LyX6q5O6-Rh0PJw3E9KPTRv59aPlINSkPrfyWYWboy-VLapbMM8nbT5p8_K3VGG1Rw4lEEUP-VAVaute2cVUgHeuQXqqzAhVNYbHzf0nioRocRDykCjgcdCE4gQGGf0NU Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Domain-Id: None Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Domain-Name: None Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Identity-Status: Confirmed Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Is-Admin-Project: True Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Domain-Id: default Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Domain-Name: Default Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Project-Name: admin Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Role: reader,admin,member Jul 18 15:06:24.160187 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Roles: reader,admin,member Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8015bf50f271424ca62c239a2df319f8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant: admin Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-Tenant-Name: admin Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User: admin Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Domain-Id: default Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Domain-Name: Default Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Id: baf04811d48d4c3fa638546a709d7179 Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: X-User-Name: admin Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: method: > Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: exception: Flavor 451 could not be found. Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: action_args: {'id': '451'} Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:06:24.161931 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:24.163424 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.164827 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-5db7d2b5-9a5c-449c-a63f-13cef7f1458e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:06:24.166192 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-5db7d2b5-9a5c-449c-a63f-13cef7f1458e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.422031 Jul 18 15:06:24.166192 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 24/49] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Jul 18 15:06:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 15:06:24.171559 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-a4f89d1f-59fe-4f26-a85e-2d49acc73e97 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:24.185799 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-a4f89d1f-59fe-4f26-a85e-2d49acc73e97 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018002 Jul 18 15:06:24.186336 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 26/50] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Jul 18 15:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:24.196787 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:24.212613 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020083 Jul 18 15:06:24.219751 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 25/51] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Jul 18 15:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:06:24.230776 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-05dd3d67-f3f5-4533-aff5-c53285aba8a9 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:24.236561 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.wsgi [None req-05dd3d67-f3f5-4533-aff5-c53285aba8a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-05dd3d67-f3f5-4533-aff5-c53285aba8a9 admin admin] Request method failure captured: Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Accept: application/json Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Accept-Encoding: gzip, deflate Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Connection: keep-alive Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Content-Length: 0 Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Host: 10.222.0.83 Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Openstack-Api-Version: compute 2.90 Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Openstack-System-Scope: None Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: User-Agent: python-novaclient Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Auth-Token: gAAAAABi1XbvGM_org9jTMS-hQmcfqtm4joA3KKnh-urPJSD7FYe29LyX6q5O6-Rh0PJw3E9KPTRv59aPlINSkPrfyWYWboy-VLapbMM8nbT5p8_K3VGG1Rw4lEEUP-VAVaute2cVUgHeuQXqqzAhVNYbHzf0nioRocRDykCjgcdCE4gQGGf0NU Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Domain-Id: None Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Domain-Name: None Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Identity-Status: Confirmed Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Is-Admin-Project: True Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Domain-Id: default Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Domain-Name: Default Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Project-Name: admin Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Role: reader,admin,member Jul 18 15:06:24.238172 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Roles: reader,admin,member Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8015bf50f271424ca62c239a2df319f8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8015bf50f271424ca62c239a2df319f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant: admin Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant-Id: 8015bf50f271424ca62c239a2df319f8 Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-Tenant-Name: admin Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User: admin Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Domain-Id: default Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Domain-Name: Default Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Id: baf04811d48d4c3fa638546a709d7179 Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: X-User-Name: admin Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: method: > Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: exception: Flavor 451 could not be found. Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: action_args: {'id': '451'} Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:06:24.239859 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:24.241444 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: ERROR nova.api.openstack.wsgi Jul 18 15:06:24.242691 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-05dd3d67-f3f5-4533-aff5-c53285aba8a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:06:24.243771 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-05dd3d67-f3f5-4533-aff5-c53285aba8a9 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015267 Jul 18 15:06:24.243771 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 27/52] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Jul 18 15:06:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 15:06:25.252151 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:25.253164 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 18 15:06:25.253563 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:25.797524 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-5a076f05-73fb-4f1b-a08b-8d6eb49aee16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:06:25.892502 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-5a076f05-73fb-4f1b-a08b-8d6eb49aee16 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.498288 Jul 18 15:06:25.893049 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 28/54] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Jul 18 15:06:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 15:06:26.898093 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:26.899147 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 18 15:06:26.899547 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:27.445593 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-c6308867-2246-405b-8dde-17764daff826 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:06:27.609009 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-c6308867-2246-405b-8dde-17764daff826 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.567748 Jul 18 15:06:27.609477 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 29/56] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Jul 18 15:06:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:06:28.610509 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:28.611547 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 18 15:06:28.611950 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:29.156018 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-a06ce79b-99ac-4f37-ace9-b8cd31292a28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:06:29.230739 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-a06ce79b-99ac-4f37-ace9-b8cd31292a28 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.475748 Jul 18 15:06:29.231314 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 30/58] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Jul 18 15:06:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:06:30.220147 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:30.221164 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 18 15:06:30.221571 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 29/59] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:30.758724 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-5d0a3729-3f42-4639-beb9-09e2640ce77e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:06:30.853806 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-5d0a3729-3f42-4639-beb9-09e2640ce77e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.488869 Jul 18 15:06:30.854261 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 31/60] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Jul 18 15:06:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:06:31.848246 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:31.849777 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 18 15:06:31.850196 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 30/61] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:06:32.399688 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-72a6d534-eb08-437f-a91d-5863bfc63bbe admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:06:32.419609 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-72a6d534-eb08-437f-a91d-5863bfc63bbe admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427367 Jul 18 15:06:32.420154 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 32/62] 10.222.0.83 () {60 vars in 1202 bytes} [Mon Jul 18 15:06:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:07:26.111743 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:07:26.112792 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-eaef7bf9-13c1-4486-aac1-bd671e9ca261 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Jul 18 15:07:26.113154 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 31/63] 10.222.0.83 () {54 vars in 930 bytes} [Mon Jul 18 15:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:07:26.124246 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:07:26.522006 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-33e9209d-8ec1-465a-a021-cb2e50976bc2 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:07:26.541652 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-33e9209d-8ec1-465a-a021-cb2e50976bc2 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421921 Jul 18 15:07:26.542112 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 33/64] 10.222.0.83 () {60 vars in 1291 bytes} [Mon Jul 18 15:07:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:07:26.566410 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-467bcf03-5074-4429-a7bb-72623b2ae062 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:07:26.569994 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:07:26.575054 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-467bcf03-5074-4429-a7bb-72623b2ae062 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013371 Jul 18 15:07:26.575602 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 32/65] 10.222.0.83 () {60 vars in 1282 bytes} [Mon Jul 18 15:07:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:07:26.588007 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-ada60d32-101d-46b6-b6fd-a384d4fe13cf admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:07:26.596715 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-ada60d32-101d-46b6-b6fd-a384d4fe13cf admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012151 Jul 18 15:07:26.597494 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 34/66] 10.222.0.83 () {60 vars in 1285 bytes} [Mon Jul 18 15:07:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:07:26.609339 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:07:26.617655 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012233 Jul 18 15:07:26.618217 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 33/67] 10.222.0.83 () {60 vars in 1285 bytes} [Mon Jul 18 15:07:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:07:26.629733 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-5d03e5f2-cdd1-40b9-be7e-27143f656577 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:07:26.637501 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-5d03e5f2-cdd1-40b9-be7e-27143f656577 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011422 Jul 18 15:07:26.638027 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 35/68] 10.222.0.83 () {60 vars in 1282 bytes} [Mon Jul 18 15:07:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:11:07.367624 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:07.368832 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 18 15:11:07.369268 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:11:07.531274 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_api:SELECT=6 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:11:07.770207 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-36367483-ca20-401e-af9f-c2cd2d07dee6 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:07.771522 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:11:07.771522 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: warnings.warn(msg) Jul 18 15:11:07.772920 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-36367483-ca20-401e-af9f-c2cd2d07dee6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:07.773390 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-36367483-ca20-401e-af9f-c2cd2d07dee6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:07.774254 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-36367483-ca20-401e-af9f-c2cd2d07dee6 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:07.774738 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-36367483-ca20-401e-af9f-c2cd2d07dee6 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:07.813531 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-36367483-ca20-401e-af9f-c2cd2d07dee6 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.291981 Jul 18 15:11:07.814131 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 36/70] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Jul 18 15:11:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:11:08.797104 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:08.799292 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002741 Jul 18 15:11:08.800488 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:11:09.040226 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-35704c4b-fb5f-4779-b63a-4d447502a820 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:09.041730 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:11:09.041730 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: warnings.warn(msg) Jul 18 15:11:09.043255 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-35704c4b-fb5f-4779-b63a-4d447502a820 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:09.044217 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-35704c4b-fb5f-4779-b63a-4d447502a820 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:09.045589 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-35704c4b-fb5f-4779-b63a-4d447502a820 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:09.046389 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-35704c4b-fb5f-4779-b63a-4d447502a820 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:09.069720 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-35704c4b-fb5f-4779-b63a-4d447502a820 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.119223 Jul 18 15:11:09.070310 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 37/72] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Jul 18 15:11:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:11:20.584065 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:20.585427 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Jul 18 15:11:20.586008 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:11:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:11:20.743730 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_cell0:SELECT=4 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:11:20.745241 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_cell1:SELECT=4 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:11:20.745949 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG dbcounter [-] [103793] Writing DB stats nova_api:SELECT=8 {{(pid=103793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:11:20.805014 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-98039679-11fa-47f5-8d5b-55caf4d0a6f2 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:20.806713 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:11:20.806713 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: warnings.warn(msg) Jul 18 15:11:20.808185 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-98039679-11fa-47f5-8d5b-55caf4d0a6f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:20.808659 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-98039679-11fa-47f5-8d5b-55caf4d0a6f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:20.809505 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-98039679-11fa-47f5-8d5b-55caf4d0a6f2 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:20.809985 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-98039679-11fa-47f5-8d5b-55caf4d0a6f2 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:20.840301 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-98039679-11fa-47f5-8d5b-55caf4d0a6f2 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.101319 Jul 18 15:11:20.840890 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Jul 18 15:11:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:11:21.789878 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:21.790970 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-001ed136-d681-4bad-81d4-ac6769022a91 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 18 15:11:21.791411 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Jul 18 15:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:11:22.007887 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG nova.api.openstack.wsgi [None req-883f74be-5720-42b5-a3fa-9db596dd2109 admin admin] Calling method '>' {{(pid=103793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:11:22.009130 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 15:11:22.009130 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: warnings.warn(msg) Jul 18 15:11:22.010458 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-883f74be-5720-42b5-a3fa-9db596dd2109 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:22.010932 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-883f74be-5720-42b5-a3fa-9db596dd2109 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:22.011733 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-883f74be-5720-42b5-a3fa-9db596dd2109 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:11:22.012223 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: DEBUG oslo_concurrency.lockutils [None req-883f74be-5720-42b5-a3fa-9db596dd2109 admin admin] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:11:22.036772 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: INFO nova.api.openstack.requestlog [None req-883f74be-5720-42b5-a3fa-9db596dd2109 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.092106 Jul 18 15:11:22.037365 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: [pid: 103793|app: 0|req: 39/76] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Jul 18 15:11:21 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:12:21.574359 dv-cinder-836973-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 15:12:21.576074 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: Mon Jul 18 15:12:21 2022 - graceful shutdown triggered... Jul 18 15:12:21.576784 dv-cinder-836973-13-iscsi devstack@n-api.service[103792]: Gracefully killing worker 1 (pid: 103792)... Jul 18 15:12:21.577365 dv-cinder-836973-13-iscsi devstack@n-api.service[103793]: Gracefully killing worker 2 (pid: 103793)... Jul 18 15:12:22.576006 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: worker 1 buried after 1 seconds Jul 18 15:12:22.576006 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: worker 2 buried after 1 seconds Jul 18 15:12:22.576006 dv-cinder-836973-13-iscsi devstack@n-api.service[103791]: goodbye to uWSGI. Jul 18 15:12:22.578049 dv-cinder-836973-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 15:12:22.578721 dv-cinder-836973-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 15:12:22.581906 dv-cinder-836973-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 15:12:22.593405 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 15:12:22 2022] *** Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: nodename: dv-cinder-836973-13-iscsi Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: machine: x86_64 Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: clock source: unix Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: pcre jit disabled Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: detected number of CPU cores: 4 Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: current working directory: / Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: detected binary path: /usr/bin/uwsgi-core Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: your processes number limit is 47680 Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: your memory page size is 4096 bytes Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: detected max file descriptor number: 2048 Jul 18 15:12:22.595694 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: lock engine: pthread robust mutexes Jul 18 15:12:22.597323 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: thunder lock: enabled Jul 18 15:12:22.597323 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 15:12:22.597323 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 15:12:22.641646 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: Python main interpreter initialized at 0x5560b4c5c9c0 Jul 18 15:12:22.641646 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: python threads support enabled Jul 18 15:12:22.641646 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: your server socket listen backlog is limited to 100 connections Jul 18 15:12:22.641646 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: your mercy for graceful operations on workers is 90 seconds Jul 18 15:12:22.642139 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 15:12:22.642139 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: *** Operational MODE: preforking *** Jul 18 15:12:22.642429 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: *** uWSGI is running in multiple interpreter mode *** Jul 18 15:12:22.642429 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: spawned uWSGI master process (pid: 118329) Jul 18 15:12:22.642712 dv-cinder-836973-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 15:12:22.646572 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: spawned uWSGI worker 1 (pid: 118339, cores: 1) Jul 18 15:12:22.646572 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: spawned uWSGI worker 2 (pid: 118340, cores: 1) Jul 18 15:12:22.646572 dv-cinder-836973-13-iscsi devstack@n-api.service[118329]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 15:12:23.364123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 15:12:23.374622 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 15:12:24.628900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:12:24.628900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: from cryptography.utils import int_from_bytes Jul 18 15:12:24.629754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:12:24.629754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: from cryptography.utils import int_from_bytes Jul 18 15:12:24.633274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:12:24.633274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: from cryptography.utils import int_from_bytes Jul 18 15:12:24.633949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 15:12:24.633949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: from cryptography.utils import int_from_bytes Jul 18 15:12:27.122911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 15:12:27.123856 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 15:12:27.124522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 15:12:27.125068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 15:12:27.125450 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 15:12:27.125952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.127067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.127263 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.127784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.128293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.128786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.129285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.129755 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.130264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.130826 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.131326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.131915 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-13-iscsi {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.132486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.133012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.133615 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.134208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.134832 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.135374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.135862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.136504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.137161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.137733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.138219 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.138771 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.139341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.139919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.140475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.140947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.141397 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.141837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.142375 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-13-iscsi {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.142875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.143325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.143894 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.144591 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.145048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.145498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.145947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.146402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.146878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.147351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.147799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.148238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.148694 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.149117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.149555 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.150008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.150525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.151029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.151468 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.151836 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.152275 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.153266 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.153715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.154239 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.154690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.155074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.155520 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.155974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.156412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.156848 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.157278 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.157712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.158312 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.158815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.160079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.160393 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.160750 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.161086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.161428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.161752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.162087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.162522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.162814 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.163142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.163498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.163906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.164317 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.166074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.166074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.166074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.166074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.166074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.168099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.169623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.169623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.169623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.170092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.170419 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.171047 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.171459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.171779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.172100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.172418 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.172736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.173053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.173374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.173712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.174042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.174443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.174785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.175104 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.175421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.175752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.176070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.176384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.176716 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.177033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.177346 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.177886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.178194 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.178679 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.178679 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.179165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.179326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.179551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.179866 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.180234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.180486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.180796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.181108 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.181422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.181735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.182048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.182358 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.182709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.183042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.183365 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.183680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.184643 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.184970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.185319 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.185658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.186013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.186338 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.186729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.187099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.187427 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.187750 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.188075 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.188417 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.188741 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.189061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.189384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.189713 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.190042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.190383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.190740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.191068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.191397 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.191723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.192049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.192391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.192724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.193045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.193563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.193831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.194152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.194554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.194983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.196031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.196031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.196353 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.196473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.196757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.197088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.197421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.197747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.198071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.198394 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.198741 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.199064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.200073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.202493 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.202906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.203250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.203600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.203938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.204440 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.206368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.206748 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.207091 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.207434 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.207778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.209369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.209732 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.210094 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.210427 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.211066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.211483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.211822 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.212148 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.212671 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.213172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.213693 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.214027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.214347 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.214731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.215120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.215452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.215815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.216107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.216617 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.216956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.217285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.217449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 15:12:27.218169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.218351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 15:12:27.218495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.218495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.218790 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.218949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 15:12:27.219093 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.219538 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.219813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 15:12:27.220152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.220152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.220833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.221103 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 15:12:27.221344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.221344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.221832 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.222090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.222090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.222748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.223039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.223039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.223564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.224032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.224032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.224595 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.225558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.225558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.226090 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.226416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.226416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.227538 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.227777 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.228199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.228448 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.228448 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.228910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.229137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.229137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.229582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.229853 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.229853 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.230462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.230772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.230772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.231263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.231542 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.231918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-13-iscsi {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.231918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.232416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.232416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.232897 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.233155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.233155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.233713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.233968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.234210 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.234458 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.234458 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.235886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.236157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.236157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.236652 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.236908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.237191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.238057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.238057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.238057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.238839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.239132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.239400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.239646 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.239646 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.240130 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.240392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.240392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.240873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.241127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.241127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.241604 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.241840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.242087 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.242337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.242337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.242864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.243107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.243355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.243634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.243634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.244079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.244341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.244341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.245007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.245740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.245740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.247192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.247457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.247457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.248681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-13-iscsi {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.248926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.248926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.249413 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.249658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.249658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.250192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.251580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.251580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.252079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.252330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.252330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.252878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.253150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.253150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.253624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.253862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.253862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.254342 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.254672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.254672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.255173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.255443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.255443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.256743 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.256978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.256978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.257459 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.257710 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.257710 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.258973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.259255 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.259255 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.259756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.260023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.260023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.260515 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.260782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.261042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.261306 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.261306 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.261780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.262634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.262907 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.263201 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.263467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.263736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.263736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.264217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.264516 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.264737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.264972 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.264972 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.265402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.265631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.266515 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.266948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.266948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.267453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.267729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.267729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.268672 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.268948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.268948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.269598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.269855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.269855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.270335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.270612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.270875 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.271136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.271136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.271604 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.271846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.272096 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.272372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.272372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.272857 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.273107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.273107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.273559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.273823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.273823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.274278 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.274628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.274628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.275095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.275362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.275362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.275827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.276118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.276118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.278854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.278854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.279118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.279118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.279358 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.279486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.279612 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.279747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.279747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.279980 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.280115 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.280234 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.280360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.280360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.280612 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.280729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.280855 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.281002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.281136 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.281253 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.281253 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.281469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.281609 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.281756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.281881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.282054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.282198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.282198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.282468 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.282661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.282661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.282956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.283109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.283280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.283422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.283422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.283726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.283877 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.284044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.284212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.284212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.284507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.284661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.284820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.284974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.284974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.285295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.285449 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.285449 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.285731 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.285898 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.285898 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.286217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.286384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.286566 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.286707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.286707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.286984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.287090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.287174 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.287253 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.287253 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.287411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.287553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.287553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.287759 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.287840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.287986 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.288143 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.288143 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.288366 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.288513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.288611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.288699 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.288851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.288969 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.288969 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.289156 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.289241 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.289333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.289430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.289430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.289591 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.289677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.289677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.289871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.289976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.290076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.290218 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.290218 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.290461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.290601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.290688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.290786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.290786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.290976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.291092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291244 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.291401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.292208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.293735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.298927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.299469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.300313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.300619 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300619 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.300844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.301009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.301009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.301187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.301274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.301274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.303915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.304067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.304329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.304610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.304792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.304929 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.305012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.305012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.305181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.305318 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.305318 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.305598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.305709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.305816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.305919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.305919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.306107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.306241 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.306241 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.310215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.310413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.310413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.310667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.310829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.310829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311110 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.311188 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.311332 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311332 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311477 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.311560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.311769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.311911 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.312045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.312183 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.312285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.312285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.312439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.312522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.312522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.314068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.314311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.314311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.314817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.315081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.315348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.315631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.315631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.316328 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.316613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.316878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.317161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.317161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.317772 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.318058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.318058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.319063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.319405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.319685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.319976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.320593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.320878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.321161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.321614 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.321890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.322151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.322151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.322904 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 15:12:27.323170 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.323438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.325533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.325533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.326178 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.326452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.326758 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.327057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.327057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.327622 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.327907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.328166 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.328425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.329050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.329337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.329626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.329885 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.329885 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.330499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.331112 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.331381 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.331667 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.331944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.332223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.332223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.332760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.333049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.333332 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.333524 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.333719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.333904 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.334435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.334702 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.334923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.335104 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.336829 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.337024 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.337024 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.337373 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.337587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.337864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.338074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.338074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.338453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.338690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.338878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.339322 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.339497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.339659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.339847 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.340118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.340118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.342432 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.343529 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.343796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.344066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.345387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.345387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.346169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.346410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.346647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.346647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.347367 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.347549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.347713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.347875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.348060 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.348254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.348505 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.348710 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.348710 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.349024 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.349257 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.349703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.349902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.350067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.350262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.350431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.350635 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.350921 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.351138 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.351453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.351729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.352004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.352297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.352747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.352955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.353127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.353289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.353475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.353651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.353828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.353999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.354181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.354687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.355317 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.355531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.355531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.355931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.356140 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.356314 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.356560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.356734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.356996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.357559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.357819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.358076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.358303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.358507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.358770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.358934 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.359096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.359274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.359531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.360118 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.360339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.360536 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.360708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.360880 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.361098 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.361365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.361625 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.361880 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.362126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.362309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.362501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.362966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.363149 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.363323 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.363486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.363647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.363821 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.364017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.364262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.364511 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.364782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.365089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.365680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.365848 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.366070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.366297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.366561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.366817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.367078 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.367344 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.367995 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.368285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.368285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.368768 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.369160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.369438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.369666 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.369854 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.370325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.373431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.373431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.373431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.374054 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.374285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.374475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.374670 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.374833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.375070 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.375070 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.375949 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.376234 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.376500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.376766 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.377044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.377303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.377600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.378300 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.378952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.379233 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.379510 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.379799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.380088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.380681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.380681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.381213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.381489 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.381772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.382058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.382328 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.382660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.382941 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.383469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.383770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.384162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.384162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.384685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.384975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.385266 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.385563 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.386314 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.386630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.386968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.387507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.387803 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.388139 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.388820 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.389251 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.389544 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.389839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.390109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.390398 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.391009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.391297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.391590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.391879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.392188 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.392460 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.392770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.393017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.393265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.393704 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.393993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.394257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.394525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.394846 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.395126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.395393 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.395393 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.395890 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.396626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.396626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.397144 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.397429 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.397429 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.397429 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.398192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.398492 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.399261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.399787 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.400062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.400345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.400624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.401226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.401518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.401799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.402081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.402348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.402680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.403007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.403317 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.403625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.404125 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.404410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.404679 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.404949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.405226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.405488 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.405752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.406038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.406344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.406828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.406828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.407377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.407642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.407923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.408192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.408465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.408765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.409015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.409618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.409618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.410383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.410716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.411006 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.411630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.411901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.412164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.412434 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.412708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.413043 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.413317 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.413585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.413851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.414141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.414620 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.414911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.415187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.415473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.415740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.416005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.416297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.416788 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.417192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.417460 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.417668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.417934 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.418813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.419101 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.419368 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.420203 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.420477 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.420764 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.421031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.421312 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.421977 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.421977 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.422655 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.422947 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.423216 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.423482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.423765 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.424024 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.424325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.424883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.425183 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.425464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.425464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.425990 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.426277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.426277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.426920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.427210 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.427561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.427755 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.428009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.428322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.428597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.428866 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.429147 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.429426 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.429711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.430008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.430855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.431132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.431360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.431552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.431830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.432412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.432715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.432998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.433281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.433552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.434883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.435319 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.435604 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.435889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.436160 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.436449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.436730 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.436925 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.437106 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.437364 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.437623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.437924 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.438107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.438316 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.438495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.438708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.438874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.439051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.439213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.439382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.439544 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.439811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.440020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.440295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.440639 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.441106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.441379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.441620 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.441799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.442005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.442477 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.442721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.442950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.443175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.443408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.443408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.443878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.445141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.445767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.446033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.446303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.446615 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.446892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.447176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.447451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.447756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.448211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.448504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.448750 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.448983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.449233 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.450005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.450288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.450619 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.451482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.451754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.452042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.452042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.452846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.452846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.453211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.453211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.453211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.453211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.453211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.453211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.454801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.455083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.455355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.455641 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.456092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.456381 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.456648 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.456905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.457173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.457451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.457451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.457451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.458387 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.458724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.458984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.459232 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.459496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.459791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.460051 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.460290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.460468 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.460642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.461159 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.462028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.462324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.462645 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.463262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.463537 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.463813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.464074 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.464390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.464648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.464889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.465731 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.466026 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.466807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.467113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.467417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.467697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.467980 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.468244 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.468703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.468989 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.469248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.469526 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.469792 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.470053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.470339 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.470677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.470948 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.471190 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.471375 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.471569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.472394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.472669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.472959 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.473561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.473837 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.474096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.474377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.474687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.474954 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.475218 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.475488 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.475488 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.475991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.476275 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.476765 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.477030 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.477294 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.477580 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.477847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.478117 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.478387 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.478756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.479044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.479323 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.479599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.479860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.480122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.480428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.481515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.481803 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.482248 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.482881 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.483059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.483240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.483696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.483955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.484210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.484461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.484739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.485005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.485005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.485579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.485830 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.486082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.486346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.486642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.487139 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.487398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.487570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.487733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.487906 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.488152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.488447 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.488712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.488928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.489497 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.489738 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.489922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.489922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.490243 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.490406 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.490629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.490813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.490998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.491169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.491351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.491513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.491683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.491846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.492023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.492209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.492209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.493009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.493193 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.493369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.493541 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.493860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.493860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.494197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.494359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.494553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.494745 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.494918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.495080 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.495249 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.495419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.495702 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.495884 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.496048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.496390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.496390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.496390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.496914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.497111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.497438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.497608 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.497772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.497952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.498127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.498290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.498459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.498675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.498838 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.499034 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.499206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.499369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.499529 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.499690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.499851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.500023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.500196 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.500394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.500565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.500737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.500900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.501076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.501261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.501425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.501586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.501586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.501903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.502065 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.502237 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.502399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.502870 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.503342 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.503530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.503705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.504018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.504204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.504376 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.504538 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.504958 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.505312 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.505487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.505487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.505803 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.505986 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.506165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.506329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.506491 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.506698 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.506874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.507048 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.507210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.507372 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.507715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.507884 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.508055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.508245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.508245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.508245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.508729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.508891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.509066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.509240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.509411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.509583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.510166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.510357 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.510725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.510951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.511146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.511551 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.511802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.512683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.514015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.514313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.514485 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.514677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.514842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.515126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.515409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.515576 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.515747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.515747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.516067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.516238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.516411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.516600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.516763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.517128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.517299 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.517472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.517678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.517988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.518172 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.518344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.518507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.518751 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.518925 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.519273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.519673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.519846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.520179 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.520365 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.520529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.520692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.520692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.521002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.522382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.523965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.525817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.527119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.529155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.530406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.531905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.533142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.534939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.536214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.537470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.538920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.540184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.541445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.543012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.544475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.545915 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.547240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.548531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.549928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.551207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.552481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.553725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.555435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.556690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.557994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.559480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.560721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.561992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.563378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.564458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.565535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.566725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.567775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.568937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.570212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.571424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.572887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.573874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.575693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.576798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.577796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.577796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.577796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.577796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 15:12:27.577796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 15:12:27.599833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Registered counter for database nova_api Jul 18 15:12:27.625341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.633272 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:27.697985 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.context [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac9e3721-a803-4db4-873c-e4d171be63cf(cell1) {{(pid=118340) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 15:12:27.702967 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:12:27.704626 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:12:27.705469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:12:27.707577 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:12:27.709637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Registered counter for database nova_cell0 Jul 18 15:12:27.714432 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Registered counter for database nova_cell1 Jul 18 15:12:27.722771 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.725273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.730119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:27.734071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:27.740487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO dbcounter [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Registered counter for database nova_api Jul 18 15:12:27.763000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_db.sqlalchemy.engines [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.770416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writer thread running {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:27.830597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.context [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac9e3721-a803-4db4-873c-e4d171be63cf(cell1) {{(pid=118339) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 15:12:27.834718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:12:27.836601 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:12:27.837429 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:12:27.839543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:12:27.841878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO dbcounter [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Registered counter for database nova_cell0 Jul 18 15:12:27.846215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO dbcounter [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Registered counter for database nova_cell1 Jul 18 15:12:27.854865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_db.sqlalchemy.engines [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.858390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_db.sqlalchemy.engines [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.864365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writer thread running {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:27.884904 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Registered counter for database nova_cell0 Jul 18 15:12:27.893074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:27.898095 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:28.016092 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writer thread running {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:28.032514 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO dbcounter [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Registered counter for database nova_cell0 Jul 18 15:12:28.041341 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_db.sqlalchemy.engines [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 15:12:28.047952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writer thread running {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 15:12:28.242658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:12:28.251746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:12:28.388404 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: WARNING keystonemiddleware.auth_token [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:12:28.396334 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: WARNING keystonemiddleware.auth_token [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:12:28.618664 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:12:28.626707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-90b71bc8-c233-4298-9b75-5d42e4dcc1a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:12:28.632621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560b4c5c9c0 pid: 118340 (default app) Jul 18 15:12:28.810345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: WARNING keystonemiddleware.auth_token [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 15:12:28.820491 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: WARNING keystonemiddleware.auth_token [None req-27319d2f-5d24-45f2-9904-a5dfc495d27a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 15:12:28.826419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560b4c5c9c0 pid: 118339 (default app) Jul 18 15:13:21.560165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:21.563114 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:21.565015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:21.567084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:22.503652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54f9861c-06da-4f6a-835c-eade66b69748 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c35fb5e0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:23.671117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54f9861c-06da-4f6a-835c-eade66b69748 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/a42576b4-c93b-4ae5-87df-329b351108b3" status: 200 len: 350 microversion: 2.1 time: 2.146048 Jul 18 15:13:23.672245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 1/1] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:13:21 2022] GET /compute/v2.1/os-volumes/a42576b4-c93b-4ae5-87df-329b351108b3 => generated 350 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:26.187720 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:26.202276 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:26.207908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:26.208952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:13:26.683117 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c788a938-9e07-472f-b67e-ff293bfb7baa tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c35fd3a0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:27.478352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c788a938-9e07-472f-b67e-ff293bfb7baa tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/3d773f26-5553-4735-ba21-546aec60b2f8" status: 200 len: 350 microversion: 2.1 time: 1.302534 Jul 18 15:13:27.479504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 1/2] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:13:26 2022] GET /compute/v2.1/os-volumes/3d773f26-5553-4735-ba21-546aec60b2f8 => generated 350 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:30.856669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-36d4b94f-67c7-4562-9d44-2e487450c0b6 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c34c0670>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:30.949224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-36d4b94f-67c7-4562-9d44-2e487450c0b6 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/0b6ff473-b666-4ecd-9825-d58ce2b21384" status: 200 len: 351 microversion: 2.1 time: 0.095820 Jul 18 15:13:30.950219 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:13:30 2022] GET /compute/v2.1/os-volumes/0b6ff473-b666-4ecd-9825-d58ce2b21384 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:30.965224 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-21b7c15b-1901-40b8-8a75-cd9654204469 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c34c4550>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:31.202376 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-21b7c15b-1901-40b8-8a75-cd9654204469 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.241760 Jul 18 15:13:31.204795 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1133 bytes} [Mon Jul 18 15:13:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:31.222567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-44643a3c-4a2c-4572-91dc-fa03a3c04b56 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c34c0dc0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:31.414189 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-44643a3c-4a2c-4572-91dc-fa03a3c04b56 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.197667 Jul 18 15:13:31.414884 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 3/5] 10.222.0.83 () {58 vars in 1148 bytes} [Mon Jul 18 15:13:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:31.429741 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e3739166-860e-4192-b5aa-7b617e18af76 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c34851f0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:31.577664 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e3739166-860e-4192-b5aa-7b617e18af76 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.153257 Jul 18 15:13:31.578640 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 3/6] 10.222.0.83 () {58 vars in 1133 bytes} [Mon Jul 18 15:13:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:31.593178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-82ca9a71-d449-40c2-9702-1f7c6f22cf3c tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c34c0d30>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:31.891171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-82ca9a71-d449-40c2-9702-1f7c6f22cf3c tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.302376 Jul 18 15:13:31.892691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1166 bytes} [Mon Jul 18 15:13:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:31.909700 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-063acc84-cd88-46cd-9376-bc206ac7af59 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c35c59d0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:32.238027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-063acc84-cd88-46cd-9376-bc206ac7af59 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.336164 Jul 18 15:13:32.246770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1169 bytes} [Mon Jul 18 15:13:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:32.253610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-714cbd22-14e3-4336-9468-8eac184fa109 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c3485310>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:32.505602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-714cbd22-14e3-4336-9468-8eac184fa109 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.256616 Jul 18 15:13:32.506180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 5/9] 10.222.0.83 () {58 vars in 1154 bytes} [Mon Jul 18 15:13:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:32.521647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3a12b086-64f7-4163-ae04-1dfc83bb6236 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c3485af0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:32.761842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3a12b086-64f7-4163-ae04-1dfc83bb6236 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.243499 Jul 18 15:13:32.772520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 5/10] 10.222.0.83 () {58 vars in 1187 bytes} [Mon Jul 18 15:13:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:13:32.785527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb18f580-b34b-47ec-9656-edf7db9996e1 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] Calling method '.version_select at 0x7f48c3485f70>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:33.143879 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb18f580-b34b-47ec-9656-edf7db9996e1 tempest-VolumesTestJSON-525626585 tempest-VolumesTestJSON-525626585-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.361073 Jul 18 15:13:33.169391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 6/11] 10.222.0.83 () {58 vars in 1154 bytes} [Mon Jul 18 15:13:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:38.232185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ead193b1-5ad2-4898-a165-62fe5132371c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: .version_select at 0x7f48c3485dc0>, body: {"keypair": {"name": "tempest-keypair-208518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaStlzpuTNaZJJP4DnZ5RC2Hi6nrhegxh5srfi2TESXBZYhTCNmHJNQUSVZL5RxhJO6jLf59jI6kbBvQFARrw+/QcT8XTLMh74aPh+OvjCj1GJJuqi7oLO5CrzAM4n1lQ=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:38.415627 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-ead193b1-5ad2-4898-a165-62fe5132371c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:38.424635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-ead193b1-5ad2-4898-a165-62fe5132371c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for user 22b86eef7820462fa4e6cbb22f30b853 and project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:38.681101 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ead193b1-5ad2-4898-a165-62fe5132371c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 1.337678 Jul 18 15:13:38.682036 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 6/12] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:13:37 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:13:42.440849 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1744569547", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:42.674292 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ad7b7f2a-692a-4b9e-b825-5785afebecbe tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'create', calling method: .version_select at 0x7f48c33e59d0>, body: {"keypair": {"name": "tempest-keypair-1049254728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJdXTvMLvPfsnwSVU9GnATlIpfEWi0t1IbMzUp+aXYIWtDBwg+gdWGy20g+eKmL5PnxrOoOegFcmRHI3Z7oUbqXCTXPtmOzsZmRz92IJaaUosD0V20Pt17RpELxOliH6Q=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:42.815752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-ad7b7f2a-692a-4b9e-b825-5785afebecbe tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:42.855063 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] validate_networks() for [('80d53c3d-afce-4553-ba02-d131a7abe419', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:13:42.859892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-ad7b7f2a-692a-4b9e-b825-5785afebecbe tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for user f3f0c37e426640f9960c1da232605e55 and project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:43.046613 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ad7b7f2a-692a-4b9e-b825-5785afebecbe tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.384597 Jul 18 15:13:43.047281 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 7/13] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Jul 18 15:13:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1387 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 15:13:45.885369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1981076432", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "networks": [{"uuid": "7faff6bd-5780-493a-9c5f-f1091cde1174"}]}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:46.216597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] validate_networks() for [('7faff6bd-5780-493a-9c5f-f1091cde1174', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:13:47.312840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:13:47.313295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:13:47.313766 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:13:47.314189 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:13:47.314652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:13:47.365996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:47.366472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:47.367440 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:47.367887 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:47.513668 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:47.526606 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for user 648c869550ee437a8e775e997c741e58 and project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:47.576341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:13:47.579391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:13:47.888512 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-795f9d6c-86f1-4e7f-82cc-61ffd47c7d61 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.375732 Jul 18 15:13:47.895390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 7/14] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:13:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 6384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:13:47.919219 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-796e24b6-8be8-4981-9fdd-1988e5407c6b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:47.920096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-796e24b6-8be8-4981-9fdd-1988e5407c6b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:48.461569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-796e24b6-8be8-4981-9fdd-1988e5407c6b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:48.504968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-796e24b6-8be8-4981-9fdd-1988e5407c6b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1222 microversion: 2.1 time: 0.607002 Jul 18 15:13:48.518589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 8/15] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:47 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1222 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:49.442810 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1450199781", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a80d15bf-5cb0-4f8d-8fa5-fa459e419fab"}], "security_groups": [{"name": "tempest-securitygroup--18692303"}], "key_name": "tempest-keypair-208518", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:49.852722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] validate_networks() for [('a80d15bf-5cb0-4f8d-8fa5-fa459e419fab', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:13:50.285431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:13:50.288780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:13:50.289349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:13:50.292000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:13:50.292000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:13:50.315098 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:50.319504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:50.322467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:50.327032 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:50.419143 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Getting quotas for project 9a337533276641a2b556a55fdab4a049. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:50.433257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Getting quotas for user 21de90974572419e906e7ac5d9d8292d and project 9a337533276641a2b556a55fdab4a049. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:50.468820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:13:50.481405 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:13:50.706828 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:13:50.707970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:13:50.710982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:13:50.711643 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:13:50.712729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:13:50.728044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:50.728678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:50.730369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:50.732088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:50.765234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:50.766695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a0182739-2b97-4dea-8f3b-213ef7dea333 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.031232 Jul 18 15:13:50.767621 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 8/16] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:13:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:13:50.769846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for user 22b86eef7820462fa4e6cbb22f30b853 and project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:50.775422 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1190027694", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:50.787293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:13:50.793759 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:13:50.870963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] validate_networks() for [('80d53c3d-afce-4553-ba02-d131a7abe419', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:13:51.035154 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-feb9e964-45bb-4021-90dd-989ab9e4f57a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.609990 Jul 18 15:13:51.038302 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 9/17] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:13:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:13:51.064986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1164488542", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a1ac9f5-015a-4283-8dc4-629581b138ba"}], "security_groups": [{"name": "tempest-securitygroup--1415859509"}], "key_name": "tempest-keypair-1049254728", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:13:51.422743 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] validate_networks() for [('7a1ac9f5-015a-4283-8dc4-629581b138ba', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:13:52.616075 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:13:52.617351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:13:52.618269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:13:52.632031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:13:52.632901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:13:52.652470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:52.657623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:52.657623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:52.657623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:52.693643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:13:52.695105 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:13:52.695751 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:52.696435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:13:52.698389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:13:52.700441 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:13:52.708281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for user f3f0c37e426640f9960c1da232605e55 and project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:52.727752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:52.730923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:52.732226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:52.734905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:52.782146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:13:52.791332 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:13:52.866161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:13:52.889340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for user 648c869550ee437a8e775e997c741e58 and project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:13:52.934311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:13:52.941687 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:13:53.073070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-83d56ed0-67c2-466a-bb28-ad7e20b6d9a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.030369 Jul 18 15:13:53.074388 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 10/18] 10.222.0.83 () {62 vars in 1187 bytes} [Mon Jul 18 15:13:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 15:13:53.082131 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2b3fe0ac-c7ad-4e30-aa60-d04e5294053d tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:53.084227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2b3fe0ac-c7ad-4e30-aa60-d04e5294053d tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:53.237889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3fb6ffab-ed53-4a01-a57d-d29b3a13a841 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.468722 Jul 18 15:13:53.245130 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 9/19] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:13:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:13:53.256660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-896dac98-5435-481b-8ba1-043f70e97918 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:53.257333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-896dac98-5435-481b-8ba1-043f70e97918 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:53.265756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2b3fe0ac-c7ad-4e30-aa60-d04e5294053d tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:53.291801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2b3fe0ac-c7ad-4e30-aa60-d04e5294053d tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1215 microversion: 2.1 time: 0.215695 Jul 18 15:13:53.298500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 11/20] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:53 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:53.320351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc1931cc-6ac9-4198-83b3-75e6599f51bc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:53.323407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc1931cc-6ac9-4198-83b3-75e6599f51bc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:53.517608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc1931cc-6ac9-4198-83b3-75e6599f51bc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:53.540663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc1931cc-6ac9-4198-83b3-75e6599f51bc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:53.545531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc1931cc-6ac9-4198-83b3-75e6599f51bc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:53.550307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc1931cc-6ac9-4198-83b3-75e6599f51bc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1282 microversion: 2.20 time: 0.248915 Jul 18 15:13:53.554809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 12/21] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:13:53 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1282 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:13:53.580387 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b1b0323c-0b7a-4aa7-a3a6-6a56f771cd13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:53.604971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b1b0323c-0b7a-4aa7-a3a6-6a56f771cd13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:53.638364 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-896dac98-5435-481b-8ba1-043f70e97918 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:53.707198 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-896dac98-5435-481b-8ba1-043f70e97918 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1234 microversion: 2.1 time: 0.460674 Jul 18 15:13:53.714170 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 10/22] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:53 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1234 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:53.837088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b1b0323c-0b7a-4aa7-a3a6-6a56f771cd13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:53.866635 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b1b0323c-0b7a-4aa7-a3a6-6a56f771cd13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1222 microversion: 2.1 time: 0.304998 Jul 18 15:13:53.867678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 13/23] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:53 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:54.317779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:54.319084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:54.331457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:54.332656 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:54.334161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:54.335647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:54.577931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a2bc8be7-5d6a-40e9-9fb4-9737d63330fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:54.579513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a2bc8be7-5d6a-40e9-9fb4-9737d63330fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:54.698768 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:54.740235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f7fe3838-b079-47fc-8d2f-ab2e029142c4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1219 microversion: 2.1 time: 0.429134 Jul 18 15:13:54.741520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 11/24] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:54 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1219 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:54.762978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:54.774222 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:54.800159 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:54.801063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:54.803643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:54.804267 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:55.015481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:55.034005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9f017eee-5498-438f-8aa5-9cfe6483f419 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1286 microversion: 2.1 time: 0.286165 Jul 18 15:13:55.035220 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 12/25] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:54 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1286 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:55.043394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-43a591bf-633d-4ceb-b087-c9a603dc7523 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:55.052961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2bc8be7-5d6a-40e9-9fb4-9737d63330fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:55.054507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-43a591bf-633d-4ceb-b087-c9a603dc7523 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:55.066278 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2bc8be7-5d6a-40e9-9fb4-9737d63330fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:55.070012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2bc8be7-5d6a-40e9-9fb4-9737d63330fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:55.076710 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a2bc8be7-5d6a-40e9-9fb4-9737d63330fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1282 microversion: 2.20 time: 0.506028 Jul 18 15:13:55.077933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 14/26] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:13:54 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1282 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:13:55.161867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-43a591bf-633d-4ceb-b087-c9a603dc7523 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:55.178289 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-43a591bf-633d-4ceb-b087-c9a603dc7523 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1222 microversion: 2.1 time: 0.141213 Jul 18 15:13:55.190831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 13/27] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:55 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:55.774448 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:55.776164 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:55.829758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:55.829758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:55.837367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:55.839516 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.057574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:56.058384 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:56.084120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:56.085732 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.104699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:56.104699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.346849 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:56.359093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c513a928-3dd9-4053-a66c-e80e7f0486d4 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1304 microversion: 2.1 time: 0.309769 Jul 18 15:13:56.365752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 14/28] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:56 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1304 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:56.380699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:56.381941 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:56.399147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:56.399977 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.401112 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:56.401742 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.464324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:56.520207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4e1494a5-bc07-4166-ba27-aaa519daa2c3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1267 microversion: 2.1 time: 0.743858 Jul 18 15:13:56.522878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 15/29] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:55 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1267 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:56.533295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:56.534251 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:56.548549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:56.550572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.556062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:56.557872 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:56.688825 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:56.712207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:56.713875 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:56.731618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7e4969d5-c7c2-4b21-8fb9-d5272f93fe42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1334 microversion: 2.20 time: 0.361142 Jul 18 15:13:56.733131 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 15/30] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:13:56 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1334 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:13:56.967032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:56.989153 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f5a83290-9296-40be-b694-7f941ada85a6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1226 microversion: 2.1 time: 0.464770 Jul 18 15:13:57.011071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 16/31] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:56 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1226 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:57.394477 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:57.407306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:57.425598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:57.438495 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:57.439879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:57.443215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:57.550027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:57.550815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:57.586868 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:57.587692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:57.595257 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:57.597128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:58.076227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:58.090768 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e7a72ea0-b6ce-40f7-a531-642ca7181371 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1273 microversion: 2.1 time: 0.546053 Jul 18 15:13:58.092375 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 17/32] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:57 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1273 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:13:58.120341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:58.121496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:58.168975 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:58.171670 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:58.175656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:58.176742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:58.379010 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:58.389019 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-17c0db2f-31ec-412f-b90c-cd460f9f60b0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1292 microversion: 2.1 time: 1.009469 Jul 18 15:13:58.390348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 16/33] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:57 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1292 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:58.397099 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:58.398564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:58.409033 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:58.412178 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:58.413412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:58.415923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:58.417806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:58.470298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:58.470298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:58.470298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ce1da259-30ea-4133-a692-831b68354221 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1352 microversion: 2.20 time: 0.359071 Jul 18 15:13:58.474419 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 18/34] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:13:58 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1352 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:13:58.617884 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:58.629227 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d883c700-2943-4c86-8a8d-ecff08dffb66 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1274 microversion: 2.1 time: 0.236963 Jul 18 15:13:58.632011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 17/35] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:58 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:59.111747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:59.113119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:59.134814 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.135551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.136527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.137013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.343567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:59.355523 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-13cbb20e-c4e2-4732-9eb6-83bd702a11af tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1273 microversion: 2.1 time: 0.247499 Jul 18 15:13:59.379578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 19/36] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:59 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:13:59.411287 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:59.414263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:59.436333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.437567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.441363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.444916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.513465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:59.524389 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:59.543270 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.553464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.556722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.558449 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.843303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:59.859733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:59.870444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:13:59.877533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-81a57f8a-3488-4193-a428-38aba0cda0c3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1340 microversion: 2.20 time: 0.380593 Jul 18 15:13:59.877533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 20/37] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:13:59 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1340 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:13:59.887659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:13:59.888654 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:13:59.904910 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.912072 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:13:59.912072 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:13:59.912072 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:00.255551 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:00.271341 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ac50f612-5604-4c63-8043-42a6f6fa6745 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.864979 Jul 18 15:14:00.271561 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 18/38] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:59 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:00.420179 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:00.420928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:00.433677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:00.451451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:00.452434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:00.453094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:00.799249 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:00.824035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5f7f04e9-4250-4170-8fdd-324672987d46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1292 microversion: 2.1 time: 0.946843 Jul 18 15:14:00.828011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 21/39] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:13:59 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1292 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:00.904708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:00.914511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:00.968463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:00.974756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:00.981251 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:00.982182 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:01.339754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:01.360932 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-df3d1a0c-85e6-40ad-87f4-e8cf0a73ad2c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.944470 Jul 18 15:14:01.362123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 19/40] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:00 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:01.372788 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:01.373677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:01.376806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:01.387780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:01.388363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:01.390039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:01.391306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:01.393460 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:01.401229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:01.406892 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4f46cf0c-1aa9-47fe-91f4-3103d02e78a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1340 microversion: 2.20 time: 0.506994 Jul 18 15:14:01.406892 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 22/41] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:00 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1340 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:01.855633 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:01.858308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:01.896950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:01.900588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:01.903766 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:01.913120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:02.078230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:02.096777 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e42bdf7c-9c38-43d3-85b5-810c0d53b6b5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1280 microversion: 2.1 time: 0.252787 Jul 18 15:14:02.105897 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 23/42] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:01 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:02.328971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:02.351364 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1c5acfc5-a42e-40a7-9afe-385154b0e642 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.987393 Jul 18 15:14:02.362852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 20/43] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:01 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:02.386238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:02.387533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:02.421764 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:02.423142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:02.432648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:02.434647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:02.436380 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:02.448429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:02.490970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:02.490970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:02.490970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:02.490970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:02.677997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:02.791384 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=4 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:02.974219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:03.011547 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:03.013854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:03.019484 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cb538330-a5fc-4e81-9647-8abddf45d02b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1340 microversion: 2.20 time: 0.590652 Jul 18 15:14:03.019484 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 21/44] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:02 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1340 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:03.125784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:03.126784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:03.141348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:03.141914 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:03.143079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:03.143695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:03.502118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:03.523013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dec58643-f6a5-4859-8258-d792e34449ff tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 1.135992 Jul 18 15:14:03.523013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 24/45] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:02 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:03.538813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:03.540825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:03.578586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:03.583575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:03.584594 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:03.586349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:03.591865 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:04.175185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:04.188789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bbf84674-7bc1-4878-bd35-6cd2ad84d65a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 1.066873 Jul 18 15:14:04.211286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 22/46] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:03 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:04.585999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:04.614776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-49416361-48cb-46f8-ad84-687671dec135 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 1.081916 Jul 18 15:14:04.614776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 25/47] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:03 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:04.629139 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:04.629924 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:04.641537 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:04.653786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:04.654881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:04.655431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:04.754095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-5eb5c939-1f11-475d-8217-5ce67be6482d req-2ade755b-97db-4135-b166-b37a2bc37281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541110c4-7284-457c-8298-e2235b1cb050", "tag": "c7f3b156-84e2-45e5-9799-67d28ad1cdd5"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:04.794453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-5eb5c939-1f11-475d-8217-5ce67be6482d req-2ade755b-97db-4135-b166-b37a2bc37281 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:04.795002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-5eb5c939-1f11-475d-8217-5ce67be6482d req-2ade755b-97db-4135-b166-b37a2bc37281 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:04.878310 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-5eb5c939-1f11-475d-8217-5ce67be6482d req-2ade755b-97db-4135-b166-b37a2bc37281 service nova] Creating event network-changed:c7f3b156-84e2-45e5-9799-67d28ad1cdd5 for instance 541110c4-7284-457c-8298-e2235b1cb050 on hv-cinder-83697 Jul 18 15:14:04.878789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-5eb5c939-1f11-475d-8217-5ce67be6482d req-2ade755b-97db-4135-b166-b37a2bc37281 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 15:14:04.880047 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:04.880520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:04.881406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:04.881865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:04.900277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.compute.rpcapi [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 15:14:04.916630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] Releasing lock "compute-rpcapi-router" {{(pid=118339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 15:14:04.973459 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-40dd7099-62b7-4730-bf60-d18c2a7f23dc None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.754092 Jul 18 15:14:04.973459 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 23/48] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:04.977676 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:04.978408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:04.998213 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:04.999011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:05.000569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:05.001484 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:05.061100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=28 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:05.172426 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=24 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:05.583893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:05.596593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dab10591-3fc6-48ab-815b-d628e2345855 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.627997 Jul 18 15:14:05.598359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 24/49] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:04 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:05.608324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:05.612389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:05.624749 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:05.635349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:05.638965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:05.640009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:05.640650 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:05.646585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:05.652830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:05.654379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-084ed558-00d0-4be3-8ba6-289dc3a0596d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 1.047526 Jul 18 15:14:05.657901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 26/50] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:04 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:05.663867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:05.683526 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:05.690442 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:05.690943 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:05.691925 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:05.692377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:06.600719 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:06.611283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a86df7cf-e6cd-40ab-97d7-f1c63d5c4407 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.952012 Jul 18 15:14:06.612588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 27/51] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:05 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:06.824826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:06.847017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-44af3cee-8704-4b78-8e6e-1e140abe491e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 1.246649 Jul 18 15:14:06.849983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 25/52] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:05 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:06.866926 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:06.868039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:06.882509 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:06.882920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:06.883885 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:06.890365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:06.960732 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-1913fba5-eb38-4148-9c22-57274edab176 req-d992d1d0-f992-4502-a43e-f194c7778af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f39d887-9b8a-4bda-9ddc-83c684c699f5", "tag": "b958f53b-b3e4-4125-a02d-1bbd7c2611fe"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:06.980469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-1913fba5-eb38-4148-9c22-57274edab176 req-d992d1d0-f992-4502-a43e-f194c7778af1 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:06.981214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-1913fba5-eb38-4148-9c22-57274edab176 req-d992d1d0-f992-4502-a43e-f194c7778af1 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:07.043452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-1913fba5-eb38-4148-9c22-57274edab176 req-d992d1d0-f992-4502-a43e-f194c7778af1 service nova] Creating event network-changed:b958f53b-b3e4-4125-a02d-1bbd7c2611fe for instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 on hv-cinder-83697 Jul 18 15:14:07.044622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-1913fba5-eb38-4148-9c22-57274edab176 req-d992d1d0-f992-4502-a43e-f194c7778af1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 15:14:07.046906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:07.047795 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:07.049087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:07.049781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:07.069231 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.compute.rpcapi [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 15:14:07.070679 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] Releasing lock "compute-rpcapi-router" {{(pid=118340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 15:14:07.120329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e94ae1e4-c2b8-416d-ac7c-60f13d73fb18 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.504648 Jul 18 15:14:07.122387 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 28/53] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:07.138829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:07.139569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:07.165290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:07.167168 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:07.168318 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:07.168952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:07.846172 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:07.858312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5f655076-2215-43e8-be51-3474f4b70f57 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 1.006942 Jul 18 15:14:07.870864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 26/54] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:06 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:07.877171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-3b90798e-8018-451c-a89b-09faeeb82c95 req-0573f7b6-9010-4673-86ef-53955bcd57c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d00e830-cb20-495b-aaf9-4f6e480f6707", "tag": "a9f26fc8-50d2-44ba-a47e-21fabea41b4e"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:07.903221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:07.905877 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-3b90798e-8018-451c-a89b-09faeeb82c95 req-0573f7b6-9010-4673-86ef-53955bcd57c2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:07.906723 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-3b90798e-8018-451c-a89b-09faeeb82c95 req-0573f7b6-9010-4673-86ef-53955bcd57c2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:07.951235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-3b90798e-8018-451c-a89b-09faeeb82c95 req-0573f7b6-9010-4673-86ef-53955bcd57c2 service nova] Creating event network-changed:a9f26fc8-50d2-44ba-a47e-21fabea41b4e for instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 on hv-cinder-83697 Jul 18 15:14:07.972563 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-3b90798e-8018-451c-a89b-09faeeb82c95 req-0573f7b6-9010-4673-86ef-53955bcd57c2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099347 Jul 18 15:14:07.973300 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 27/55] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:07.989873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:07.989873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:08.029710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:08.036703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:08.038051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:08.039018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:08.105202 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:08.127173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:08.143384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:08.143384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-355aab6a-98bd-4eaf-bc8a-b9846adfe563 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 1.008263 Jul 18 15:14:08.143384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 29/56] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:07 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:08.143384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:08.144329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:08.170235 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:08.171043 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:08.172133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:08.172823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:08.564213 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:08.570944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:08.576494 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-377a927b-47a7-40e7-9488-b1ac2dae49c7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.598611 Jul 18 15:14:08.600878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 28/57] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:07 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:08.886587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:08.889300 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:08.926581 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:08.932553 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:08.934557 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:08.938436 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:09.471296 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:09.496517 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:09.513970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-41f38ce6-0300-427f-8c8c-17843991c6bf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 1.373792 Jul 18 15:14:09.517828 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 30/58] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:08 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:09.525497 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:09.526975 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:09.554298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:09.555406 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:09.556742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:09.557004 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:09.612980 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:09.617523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1c41804c-fa97-4ddd-9044-5b6a69de957a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.741791 Jul 18 15:14:09.618138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 29/59] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:08 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:09.623951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-a4754f3f-555a-452c-b496-32e11915e157 req-d35b957f-899a-4b82-ab3f-2424bb213f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35578724-751f-4251-a982-8a758ca6a1a9", "tag": "6d083045-63ac-45b2-9261-3a615cc1029a"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:09.636474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a4754f3f-555a-452c-b496-32e11915e157 req-d35b957f-899a-4b82-ab3f-2424bb213f52 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:09.637167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a4754f3f-555a-452c-b496-32e11915e157 req-d35b957f-899a-4b82-ab3f-2424bb213f52 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:09.654113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-a4754f3f-555a-452c-b496-32e11915e157 req-d35b957f-899a-4b82-ab3f-2424bb213f52 service nova] Creating event network-changed:6d083045-63ac-45b2-9261-3a615cc1029a for instance 35578724-751f-4251-a982-8a758ca6a1a9 on hv-cinder-83697 Jul 18 15:14:09.660560 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-a4754f3f-555a-452c-b496-32e11915e157 req-d35b957f-899a-4b82-ab3f-2424bb213f52 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040205 Jul 18 15:14:09.661733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 30/60] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:09.681611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:09.682761 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:09.696254 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:09.696734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:09.698462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:09.699170 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:10.416330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:10.418096 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:10.433261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:10.433542 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6b182d43-9350-45f5-98e1-03fd7e30a6cf tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.760893 Jul 18 15:14:10.442973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 31/61] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:09 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:10.447631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:10.448669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-a3937bbe-26ec-41e1-891d-7327c3027514 req-1f43e293-7fa8-41fd-a97c-3f83be36a48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:10.470721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3bf329c9-9c63-40cd-a92b-dc7d63e9d607 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.939671 Jul 18 15:14:10.474991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 31/62] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:09 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:10.484536 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a3937bbe-26ec-41e1-891d-7327c3027514 req-1f43e293-7fa8-41fd-a97c-3f83be36a48f service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:10.484991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a3937bbe-26ec-41e1-891d-7327c3027514 req-1f43e293-7fa8-41fd-a97c-3f83be36a48f service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:10.522965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-a3937bbe-26ec-41e1-891d-7327c3027514 req-1f43e293-7fa8-41fd-a97c-3f83be36a48f service nova] Creating event network-changed:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:14:10.530950 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-a3937bbe-26ec-41e1-891d-7327c3027514 req-1f43e293-7fa8-41fd-a97c-3f83be36a48f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085820 Jul 18 15:14:10.532196 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 32/63] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:10.547170 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:10.547817 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:10.572258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:10.573127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:10.576484 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:10.576484 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:10.654892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:10.660289 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:10.709270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:10.720741 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:10.725295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:10.726048 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:11.118878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:11.146042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-04827b6f-de3b-414f-9549-4a1e6d8a6066 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.612983 Jul 18 15:14:11.147424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 32/64] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:10 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:11.187431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:11.198203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9288a0b3-cdaa-4ffa-935a-c7ba2e3183ec tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.561704 Jul 18 15:14:11.200090 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 33/65] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:10 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:11.454985 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:11.456016 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:11.472454 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:11.473195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:11.474203 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:11.474844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:11.493971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:11.501273 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:11.516671 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:11.517032 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:11.518030 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:11.518673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:11.945209 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:11.962516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:11.964407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:11.965669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-adf35f1c-76fe-42df-a7ea-d4e465c47156 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.476090 Jul 18 15:14:11.983157 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 34/66] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:11 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:14:12.173823 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:12.174473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:12.202255 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:12.209150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:12.209150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:12.209150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:12.376981 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:12.401723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bdeea24b-be20-4acb-a2a0-f4fe95a59b4b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.943381 Jul 18 15:14:12.405056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 33/67] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:11 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:12.419952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:12.420966 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:12.449717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:12.453908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:12.463711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:12.463711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:12.736880 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:12.752411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ff6adf81-2170-41bc-bf89-920c67374b7c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.588874 Jul 18 15:14:12.752411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 35/68] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:12 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:13.003788 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:13.003788 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:13.008269 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:13.008817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:13.009649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:13.010148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:13.148351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:13.164286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-206d84c4-d5ea-49ef-b9d5-01371afc284b tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.757254 Jul 18 15:14:13.164939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 34/69] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:12 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:13.334499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:13.345726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:13.347488 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:13.349520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a4d1bcac-595f-4412-95e9-eae0c8c0c0ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.363099 Jul 18 15:14:13.350353 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 36/70] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:12 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:13.427512 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:13.428152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:13.445366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:13.446233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:13.451598 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:13.451598 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:13.686901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:13.705691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-95acb82a-38c8-4fcb-82c8-a7dba3b08091 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.280516 Jul 18 15:14:13.710725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 35/71] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:13 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:13.767131 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:13.768127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:13.775825 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:13.776285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:13.777106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:13.777602 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:13.962696 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:13.970822 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f2e52756-8195-49b7-8d9f-4f580e787cea tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.207607 Jul 18 15:14:13.971656 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 37/72] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:13 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:14.188022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:14.188636 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:14.196536 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:14.197423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:14.198424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:14.199724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:14.369625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:14.370517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:14.381012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:14.391156 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:14.393030 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:14.393924 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:14.397650 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:14.420376 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0a81d0ed-ac7c-4ad5-a95e-91006c5af1e0 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.235760 Jul 18 15:14:14.421433 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 36/73] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:14 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:14.618142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:14.625439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:14.627058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:14.629002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cc6aa90a-feac-4e49-9d81-99fa012cbf23 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.264977 Jul 18 15:14:14.630171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:14 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:14.728445 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:14.731845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:14.737052 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:14.737581 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:14.738758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:14.739759 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.060155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:15.060155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:15.060155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:15.060155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:15.061211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.061211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:15.061211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.181241 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:15.189428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c775887-e9db-47d7-a988-ad4e8322b464 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.467172 Jul 18 15:14:15.190034 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 37/75] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:14 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:15.212875 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:15.220967 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5d226b5a-d805-4b34-9fea-7914c3236a0e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.233563 Jul 18 15:14:15.221575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 39/76] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:14 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:15.438580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:15.439203 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:15.445462 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:15.445927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.446743 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:15.447192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.593376 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:15.602250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9d4ca0f2-6044-4ac7-80ca-2027e4f8a98c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.167548 Jul 18 15:14:15.602917 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 38/77] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:15 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:15.649334 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:15.649842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:15.656162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:15.656619 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.657390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:15.658037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:15.809862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:15.819399 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:15.821099 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:15.822152 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4e1385c7-9e5d-44fc-ad25-40550fb13baf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.177675 Jul 18 15:14:15.822757 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 40/78] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:15 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:14:16.207258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:16.208767 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:16.215531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.215983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.216770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.217210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.242733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:16.243688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:16.250418 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.253529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.253529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.253529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.391071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:16.400419 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6c800538-9b5c-412f-9b4a-36002b6dc44e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.197036 Jul 18 15:14:16.401362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 39/79] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:16 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:16.445789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:16.454248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4683613f-7127-4d7f-8051-2dd6cf0300e6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.217012 Jul 18 15:14:16.454895 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 41/80] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:16 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:16.620180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:16.620802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:16.627062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.627452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.628515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.628654 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.784533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:16.797720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-648de94e-60c2-487d-bdbe-f6af13248753 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.181377 Jul 18 15:14:16.798622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 40/81] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:16 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:16.841801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:16.842420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:16.849722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.850194 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:16.851043 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:16.851500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:17.019163 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:17.029910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:17.031650 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:17.033052 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dc3b45ad-3a10-47c0-8153-9316934be4e3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.195271 Jul 18 15:14:17.034581 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 42/82] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:16 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:17.417923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:17.419222 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:17.421181 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:17.426274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:17.427162 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:17.427989 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:17.428435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:17.474373 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:17.475169 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:17.482469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:17.483114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:17.484012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:17.484456 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:17.637202 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:17.653817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:17.674257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-30826cc3-aa83-4dfd-8fde-1b263bfd0067 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.204916 Jul 18 15:14:17.675041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d13f35c7-e62b-4312-a7f2-d1b7b5e72ce5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.247608 Jul 18 15:14:17.676153 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 41/83] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:17 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:17.683530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 43/84] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:17 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:17.815381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:17.816214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:17.823982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:17.825890 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:17.827207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:17.828046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.054963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:18.056315 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:18.072485 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.073124 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.074043 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.074931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.088046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:18.097379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ea6bd2b8-2a93-4f21-938d-23bee6a38306 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.286059 Jul 18 15:14:18.098157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 42/85] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:17 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:18.257151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:18.268634 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:18.270258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:18.276133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-005b22ff-bd0a-45ce-9f25-b36e98439be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.223024 Jul 18 15:14:18.276133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 44/86] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:18 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:14:18.675936 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-9b6d516b-d8c3-40b5-9561-3ba70731537a req-3f77d035-0764-4d42-9b79-b252a6c42bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541110c4-7284-457c-8298-e2235b1cb050", "name": "network-vif-plugged", "status": "completed", "tag": "c7f3b156-84e2-45e5-9799-67d28ad1cdd5"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:18.685383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-9b6d516b-d8c3-40b5-9561-3ba70731537a req-3f77d035-0764-4d42-9b79-b252a6c42bcb service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.686032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-9b6d516b-d8c3-40b5-9561-3ba70731537a req-3f77d035-0764-4d42-9b79-b252a6c42bcb service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.700842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-9b6d516b-d8c3-40b5-9561-3ba70731537a req-3f77d035-0764-4d42-9b79-b252a6c42bcb service nova] Creating event network-vif-plugged:c7f3b156-84e2-45e5-9799-67d28ad1cdd5 for instance 541110c4-7284-457c-8298-e2235b1cb050 on hv-cinder-83697 Jul 18 15:14:18.701396 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:18.702062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:18.707426 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-9b6d516b-d8c3-40b5-9561-3ba70731537a req-3f77d035-0764-4d42-9b79-b252a6c42bcb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099730 Jul 18 15:14:18.709391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 43/87] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:18.711909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.718975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.718975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.718975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.719223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:18.719223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:18.727834 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.728281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.729276 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:18.729883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:18.950445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:18.960782 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1b2103be-4198-449b-9b27-70676620a75a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.263788 Jul 18 15:14:18.964556 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 45/88] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:18 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:18.979058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:18.986844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e3756743-fc79-4540-b878-1c1ebc08a466 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.276019 Jul 18 15:14:18.987437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 44/89] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:18 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:19.117072 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:19.117724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:19.125545 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:19.126276 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:19.127294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:19.127735 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:19.290006 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:19.290714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:19.299690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:19.304856 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:19.307502 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:19.308290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:19.309757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:19.310858 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e37eb37e-8904-4da2-a2e2-f06e924ccd91 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.199941 Jul 18 15:14:19.311102 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:19.311931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 46/90] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:19 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:19.524377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:19.532633 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:19.534177 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:19.535362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8a79e717-21dc-4737-82ca-30be88231d4f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.249631 Jul 18 15:14:19.535930 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 45/91] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:19 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:19.979469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:19.980159 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:20.000387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.000387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.000387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.000387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.011157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:20.012339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:20.025667 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.026168 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.029000 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.029000 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.168751 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:20.183096 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-804dc516-6bf4-45e3-b3f8-2b64d32a851a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.204084 Jul 18 15:14:20.188202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 47/92] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:19 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:20.202584 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:20.217288 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f04f414e-71fb-4a28-af81-fcce82037fd6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.215987 Jul 18 15:14:20.224345 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 46/93] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:19 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:20.330928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:20.331554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:20.340261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.341065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.342207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.342808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.517634 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:20.531312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-992c1eee-be50-49be-bbaf-95992776591c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.204342 Jul 18 15:14:20.531960 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 48/94] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:20 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:20.553570 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:20.554187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:20.561524 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.561996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.562825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.563269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.722768 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:20.725616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-1912682a-52f8-4828-814d-c5285e61087e req-8d32f36b-73e6-419a-b380-f26b0b7056c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f39d887-9b8a-4bda-9ddc-83c684c699f5", "name": "network-vif-plugged", "status": "completed", "tag": "b958f53b-b3e4-4125-a02d-1bbd7c2611fe"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:20.731143 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:20.732666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:20.733797 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-84cd185f-a611-45b2-b39a-842f21d9490b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.184252 Jul 18 15:14:20.734095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-1912682a-52f8-4828-814d-c5285e61087e req-8d32f36b-73e6-419a-b380-f26b0b7056c0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:20.734365 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 47/95] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:20 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:20.734574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-1912682a-52f8-4828-814d-c5285e61087e req-8d32f36b-73e6-419a-b380-f26b0b7056c0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:20.748185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-1912682a-52f8-4828-814d-c5285e61087e req-8d32f36b-73e6-419a-b380-f26b0b7056c0 service nova] Creating event network-vif-plugged:b958f53b-b3e4-4125-a02d-1bbd7c2611fe for instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 on hv-cinder-83697 Jul 18 15:14:20.757938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-1912682a-52f8-4828-814d-c5285e61087e req-8d32f36b-73e6-419a-b380-f26b0b7056c0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036201 Jul 18 15:14:20.758588 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 49/96] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:14:21.199032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:21.200651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:21.210453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.210977 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.212306 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.213207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.219163 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:21.243389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:21.244119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:21.257927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.259178 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.260245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.260871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.466854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:21.481351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-90e19837-e0f0-4a13-a643-8c0b7a55bd99 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.243620 Jul 18 15:14:21.493543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 50/97] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:21 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:21.541011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:21.562951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:21.564398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-084bc89c-bd13-4dde-b48c-16c8d2168f0a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.370985 Jul 18 15:14:21.564524 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:21.575848 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 48/98] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:21 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:21.576155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.576155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.576155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.576155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.741188 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:21.749202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8d92a3a5-a777-4ea9-bfde-a11901292e69 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.196226 Jul 18 15:14:21.749799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 51/99] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:21 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:21.765002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:21.765729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:21.776953 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.777607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.778397 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:21.778871 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:21.998225 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:22.012589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:22.014462 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:22.015800 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-103431f3-4ef6-4d4a-9e2a-8cfca051ecb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.256088 Jul 18 15:14:22.017018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 49/100] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:21 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:22.500401 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:22.501062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:22.508647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:22.509137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:22.509890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:22.510993 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:22.587789 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:22.588713 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:22.608349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:22.609097 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:22.610408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:22.611185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:22.731905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:22.742338 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5d05f102-1b03-4220-8542-3fabb9db1509 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.246117 Jul 18 15:14:22.743130 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 52/101] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:22 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:22.776954 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:22.777703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:22.784276 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:22.784832 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:22.785709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:22.786278 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:22.955376 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:22.956047 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:22.966367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-144e14da-7675-406b-93db-bdfacdd48319 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.385218 Jul 18 15:14:22.967100 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ace59ce1-20d8-4e9b-9830-c5277503fbe1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.193882 Jul 18 15:14:22.968349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 53/102] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:22 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:22.968489 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 50/103] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:22 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:23.035850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:23.036462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:23.043091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:23.043548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:23.044327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:23.044770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:23.222490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:23.232397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:23.234263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:23.235593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-266a8612-db7e-4e9a-99d8-a48c3d022842 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.204046 Jul 18 15:14:23.236165 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 54/104] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:23 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:23.761332 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:23.762127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:23.768470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:23.769059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:23.769939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:23.770470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:23.923123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:23.932465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4e7f27c8-971b-40a2-bc3f-36ea7bb8340b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.175112 Jul 18 15:14:23.933113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 51/105] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:23 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:23.985766 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:23.986568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:23.994105 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:23.994772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:24.001576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.002025 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.003097 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.003701 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.004213 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.004738 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.007067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.007813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.171766 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:24.183218 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0b5a668b-70f8-4508-9106-0e55270df28f tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.193385 Jul 18 15:14:24.184456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 52/106] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:23 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:24.195141 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:24.204037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d839498b-252d-43ae-aace-c7bd249d0b84 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.222636 Jul 18 15:14:24.205177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 55/107] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:23 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:24.253600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:24.254325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:24.262109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.262666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.263467 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.263908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.431050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:24.442232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:24.444368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:24.445508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1cbe7c0d-a542-4cef-bec0-cff046305453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.195885 Jul 18 15:14:24.446092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 53/108] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:24 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:24.957226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:24.959416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:24.967826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.968549 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:24.969621 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:24.970438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.162161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:25.171182 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0c823b78-dc93-44e4-99f1-76e04d69eb97 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.223760 Jul 18 15:14:25.171984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 56/109] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:24 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:25.202191 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:25.202870 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:25.210588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:25.211355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.212324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:25.212934 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.224522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:25.225144 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:25.237654 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:25.241323 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.243855 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:25.244462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.497187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:25.507811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eea01387-c685-453d-8a9f-bc8ecd451c83 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.309334 Jul 18 15:14:25.511343 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 54/110] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:25 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:25.524712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:25.525403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:25.546366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:25.548315 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.551200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:25.551692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:25.607683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:25.627313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9bc98bba-aca8-4519-beea-7e0cff436b13 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.407362 Jul 18 15:14:25.634665 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 57/111] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:25 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:25.785880 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:25.794867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:25.796518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:25.797800 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-13ef8401-2924-41b0-92bd-0ead31cf8e30 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.284835 Jul 18 15:14:25.798413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 55/112] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:25 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:26.188778 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:26.190214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:26.197490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.197941 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.198762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.199203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.491981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:26.504249 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8aa6dd7d-5f8d-4c39-8909-9712e9618ebe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1358 microversion: 2.1 time: 0.316905 Jul 18 15:14:26.504249 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 58/113] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:26 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:26.547084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:26.547702 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:26.555161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.555928 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.556909 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.557523 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.663098 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:26.664229 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:26.673863 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.677377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.678850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.684497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.779668 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:26.792942 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1eca2940-bb3b-4306-bcdf-9794d966c18e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.251089 Jul 18 15:14:26.794459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 56/114] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:26 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:26.819688 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:26.821157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:26.838411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.838904 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.839756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.840199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:26.934994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:26.945475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-aad42df1-60b6-4492-a898-d8f23f72b165 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.288021 Jul 18 15:14:26.946910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 59/115] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:26 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:26.976457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-bab69ca7-066b-470c-a629-4f1944326363 req-7142cf43-0987-4803-81ff-5cbee59b8171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "name": "network-vif-plugged", "status": "completed", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:26.986296 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-bab69ca7-066b-470c-a629-4f1944326363 req-7142cf43-0987-4803-81ff-5cbee59b8171 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:26.986816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-bab69ca7-066b-470c-a629-4f1944326363 req-7142cf43-0987-4803-81ff-5cbee59b8171 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:27.017293 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-bab69ca7-066b-470c-a629-4f1944326363 req-7142cf43-0987-4803-81ff-5cbee59b8171 service nova] Creating event network-vif-plugged:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:14:27.027646 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-bab69ca7-066b-470c-a629-4f1944326363 req-7142cf43-0987-4803-81ff-5cbee59b8171 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055832 Jul 18 15:14:27.030648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 60/116] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:27.057472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:27.070405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:27.078978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:27.080902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ee78254d-834b-4beb-be37-d8974ab4f276 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.267379 Jul 18 15:14:27.082197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 57/117] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:26 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:27.524554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:27.525286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:27.532082 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:27.532598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:27.533588 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:27.534031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:27.815853 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:27.817064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:27.834787 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:27.841658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:27.860900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:27.866056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:27.866641 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:27.884265 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-83d55317-f312-498f-83a0-1420448f4b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1545 microversion: 2.1 time: 0.365611 Jul 18 15:14:27.887012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 61/118] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:27 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1545 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:27.920661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:27.920661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:27.934193 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:27.934705 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:27.936816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:27.937534 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:28.138781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:28.150650 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-abe9b4cb-d87f-4cad-8c40-f7064cf6e66e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.342211 Jul 18 15:14:28.151662 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 58/119] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:27 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:28.158518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:28.159553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:28.173567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:28.174709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:28.175779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:28.176574 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:28.237793 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-24299cdc-4a22-4077-bf7d-fa113182beba tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.328978 Jul 18 15:14:28.238439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 62/120] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:14:27 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-interface => generated 285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:14:28.245165 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:28.250258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:28.257185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:28.258016 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:28.259191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:28.260203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:28.368178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:28.378005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cfb6b915-065a-4f18-88f1-f02e42702837 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.224612 Jul 18 15:14:28.381170 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 59/121] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:28 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:28.654687 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:28.671824 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:28.674651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:28.676362 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4e4b5689-b8f0-4752-aa9e-62668091fce6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1408 microversion: 2.20 time: 0.436363 Jul 18 15:14:28.677931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 63/122] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:28 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:14:29.044070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-4201e6c3-360c-4540-9cdc-85370b2816e6 req-2e913aff-61f5-4236-82a2-cccef379f861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35578724-751f-4251-a982-8a758ca6a1a9", "name": "network-vif-plugged", "status": "completed", "tag": "6d083045-63ac-45b2-9261-3a615cc1029a"}, {"server_uuid": "4d00e830-cb20-495b-aaf9-4f6e480f6707", "name": "network-vif-plugged", "status": "completed", "tag": "a9f26fc8-50d2-44ba-a47e-21fabea41b4e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:29.054434 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-4201e6c3-360c-4540-9cdc-85370b2816e6 req-2e913aff-61f5-4236-82a2-cccef379f861 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.054846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-4201e6c3-360c-4540-9cdc-85370b2816e6 req-2e913aff-61f5-4236-82a2-cccef379f861 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.069305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-4201e6c3-360c-4540-9cdc-85370b2816e6 req-2e913aff-61f5-4236-82a2-cccef379f861 service nova] Creating event network-vif-plugged:6d083045-63ac-45b2-9261-3a615cc1029a for instance 35578724-751f-4251-a982-8a758ca6a1a9 on hv-cinder-83697 Jul 18 15:14:29.069899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-4201e6c3-360c-4540-9cdc-85370b2816e6 req-2e913aff-61f5-4236-82a2-cccef379f861 service nova] Creating event network-vif-plugged:a9f26fc8-50d2-44ba-a47e-21fabea41b4e for instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 on hv-cinder-83697 Jul 18 15:14:29.076940 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-4201e6c3-360c-4540-9cdc-85370b2816e6 req-2e913aff-61f5-4236-82a2-cccef379f861 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036478 Jul 18 15:14:29.077567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 60/123] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:29.168681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:29.169452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:29.180776 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.181454 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.182365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.182950 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.399731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:29.401084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:29.416147 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.417710 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.428551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.428551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.534716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:29.548472 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cccd4865-7a87-49f7-887a-1fb4f0c884aa tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.384000 Jul 18 15:14:29.549293 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 64/124] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:29 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:29.701820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:29.701820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:29.706673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.707380 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.709431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:29.710113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:29.739183 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:29.856470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:29.876702 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cbe6da83-c4ad-41b6-a748-aa60e96f6b12 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.481647 Jul 18 15:14:29.880698 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 61/125] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:29 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:30.012606 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:30.022479 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:30.024272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:30.025707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4abd3947-3aac-422f-a422-04aa3128646b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1600 microversion: 2.20 time: 0.333507 Jul 18 15:14:30.026564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 65/126] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:14:29 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1600 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:14:30.049205 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:30.049778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:30.058950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.059492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:30.060294 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.060733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:30.215079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-35c23cca-2f2c-4b19-8086-e9acd7c8544d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.173424 Jul 18 15:14:30.222817 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 62/127] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Jul 18 15:14:30 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:14:30.420861 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-4b145fb9-df5a-49cb-96cf-ea312e34be08 req-2bd9d263-7b36-4725-a0ee-08f995e63188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f39d887-9b8a-4bda-9ddc-83c684c699f5", "tag": "b958f53b-b3e4-4125-a02d-1bbd7c2611fe"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:30.437823 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-4b145fb9-df5a-49cb-96cf-ea312e34be08 req-2bd9d263-7b36-4725-a0ee-08f995e63188 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.438155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-4b145fb9-df5a-49cb-96cf-ea312e34be08 req-2bd9d263-7b36-4725-a0ee-08f995e63188 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:30.474011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-4b145fb9-df5a-49cb-96cf-ea312e34be08 req-2bd9d263-7b36-4725-a0ee-08f995e63188 service nova] Creating event network-changed:b958f53b-b3e4-4125-a02d-1bbd7c2611fe for instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 on hv-cinder-83697 Jul 18 15:14:30.490616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-4b145fb9-df5a-49cb-96cf-ea312e34be08 req-2bd9d263-7b36-4725-a0ee-08f995e63188 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073355 Jul 18 15:14:30.499129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 66/128] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:30.566122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:30.566787 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:30.574391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.574882 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:30.575678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.576388 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:30.903250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:30.904041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:30.922015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.922504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:30.923321 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:30.923801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:31.132671 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:31.149506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-669a189f-7333-4e41-b6a0-73d213ead677 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1322 microversion: 2.1 time: 0.258826 Jul 18 15:14:31.151712 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 67/129] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:30 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:31.500532 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:31.533267 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fcf88653-5228-4b5b-a927-32a9ff746df3 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1315 microversion: 2.1 time: 0.971273 Jul 18 15:14:31.534360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 63/130] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:30 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:32.181771 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:32.184168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:32.208094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:32.210340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:32.211926 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:32.213150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:32.530930 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:32.542210 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d0aa6b50-de6c-4554-b87f-c7c1182a32f5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1516 microversion: 2.1 time: 0.368867 Jul 18 15:14:32.543842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 68/131] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:32 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:32.574614 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:32.575993 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:32.577264 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:32.581107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:32.589970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:32.590420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:32.592486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:32.593328 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:32.599069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:32.600321 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:32.601578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:32.602446 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:32.632157 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lazy-loading 'flavor' on Instance uuid 35578724-751f-4251-a982-8a758ca6a1a9 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:14:33.193103 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-36df1797-abc8-44bc-a308-62ea57df2852 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9/action" status: 200 len: 32 microversion: 2.1 time: 0.624497 Jul 18 15:14:33.194659 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 69/132] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:14:32 2022] POST /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9/action => generated 32 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 15:14:33.211250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:33.215959 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:33.232975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:33.233439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:33.234305 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:33.234808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:33.261903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:33.275678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fb4c2c7f-1bf1-4672-b861-25e4d25591ac tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1501 microversion: 2.1 time: 0.717364 Jul 18 15:14:33.282452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 64/133] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:32 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1501 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:33.477672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-8d9fcbf8-62d4-49be-bc2c-8b7e81df8cc3 req-497a51b1-8a37-410a-b037-f0e0dd74b513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:33.490193 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:33.496897 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8d9fcbf8-62d4-49be-bc2c-8b7e81df8cc3 req-497a51b1-8a37-410a-b037-f0e0dd74b513 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:33.498028 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8d9fcbf8-62d4-49be-bc2c-8b7e81df8cc3 req-497a51b1-8a37-410a-b037-f0e0dd74b513 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:33.499636 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bcc82165-e5fb-416f-9e3d-d33f90611e62 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.298219 Jul 18 15:14:33.500239 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 70/134] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:33 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:33.537053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-8d9fcbf8-62d4-49be-bc2c-8b7e81df8cc3 req-497a51b1-8a37-410a-b037-f0e0dd74b513 service nova] Creating event network-changed:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:14:33.543077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-8d9fcbf8-62d4-49be-bc2c-8b7e81df8cc3 req-497a51b1-8a37-410a-b037-f0e0dd74b513 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075117 Jul 18 15:14:33.543893 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 65/135] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:14:34.524094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:34.526208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:34.537668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:34.537668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:34.539098 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:34.539706 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:34.778361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:34.791904 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-175f8f54-297c-4442-998c-1b190893354b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.275696 Jul 18 15:14:34.795447 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 71/136] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:34 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:35.814813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:35.816597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:35.819181 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=82 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:35.825565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:35.826123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:35.827053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:35.827588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:35.849744 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:35.987783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:35.996325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef4a6b5e-303b-46d8-ac47-c1b42c64f6c5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.186671 Jul 18 15:14:35.996926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 66/137] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:35 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:36.089826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "195193a2-fc14-4acc-98d2-2b363e772231"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:36.092575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:36.101201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:36.105962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:36.105962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:36.105962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:37.014181 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:37.014911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:37.021573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:37.022204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:37.023112 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:37.023628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:37.267092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:37.276769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-08716e89-1c35-4e8c-81d2-098505773d77 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.267034 Jul 18 15:14:37.277377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 67/138] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:37 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:37.341793 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-598a2dba-d82b-49a3-a118-72d76dfe4b21 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "POST /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.258152 Jul 18 15:14:37.342445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 72/139] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:14:36 2022] POST /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707/os-volume_attachments => generated 194 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:38.300737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:38.301853 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:38.317733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:38.320161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:38.321600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:38.322385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:38.546362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:38.556379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2c01a2b9-98b1-49c4-843f-8b7168c2b5be tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.263909 Jul 18 15:14:38.556627 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 68/140] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:38 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:39.575454 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:39.577936 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:39.596666 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:39.597691 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:39.601079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:39.602661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:39.785691 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:39.796717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d6163b40-1ab3-4e8d-b65c-6f4cded8a122 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.225940 Jul 18 15:14:39.798658 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 73/141] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:39 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:40.815786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:40.817133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:40.825379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:40.826307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:40.827306 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:40.828124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:41.045266 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:41.055228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0aebce24-a294-4d60-a2e6-3c54dbe35db1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.243269 Jul 18 15:14:41.056096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 69/142] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:40 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:42.074026 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:42.074829 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:42.080307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=94 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:42.086798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:42.087611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:42.088718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:42.089416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:42.275810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:42.289873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a23739e8-fbc4-4e6c-b032-ce3ae943fbe3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.219846 Jul 18 15:14:42.291291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 74/143] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:42 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:43.316047 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:43.317178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:43.328812 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:43.329646 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:43.331335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:43.332199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:43.488460 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:43.496694 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-79b8a46e-25cf-473b-91d4-a2c89a05aeb0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.185865 Jul 18 15:14:43.497305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 70/144] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:43 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:44.515177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:44.516028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:44.525682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:44.526129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:44.530502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:44.530502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:44.692716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:44.702810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-935f2d7f-ce68-42b0-a050-508c65a3afb7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.191648 Jul 18 15:14:44.703436 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 75/145] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:44 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:45.728228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:45.729825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:45.738988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:45.741168 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:45.742830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:45.743692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:45.928507 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:45.937434 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-946b8df0-86ee-4283-be20-153fea496c46 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.219486 Jul 18 15:14:45.938025 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 71/146] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:45 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:46.957248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:46.957801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:46.969908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:46.971088 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:46.972492 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:46.973166 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:47.133242 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:47.141443 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c22ffd76-d858-4307-b93a-d6040f705b57 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.188771 Jul 18 15:14:47.142280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 76/147] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:46 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:48.159536 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:48.160152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:48.167432 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:48.168234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:48.168630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:48.169111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:48.344749 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:48.354195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2caf036d-f09c-4b1d-9c76-16d363ca5793 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.198616 Jul 18 15:14:48.355521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 72/148] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:48 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:49.377978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:49.379373 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:49.392473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:49.393327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:49.395072 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:49.395585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:49.569246 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:49.577194 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-94b1e171-b577-4758-84b3-9c6a1f2cedba tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.205662 Jul 18 15:14:49.577983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 77/149] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:49 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:50.595455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:50.596190 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:50.603606 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:50.604059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:50.604845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:50.605283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:50.740542 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:50.748446 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e0cdbe57-af8f-4943-a2bb-28d92ec1d765 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.156956 Jul 18 15:14:50.749151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 73/150] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:50 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:51.622483 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-276096043", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:51.680327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] validate_networks() for None {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:14:51.762955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:51.764115 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:51.777010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:51.777010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:51.777010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:51.777010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:51.802295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:14:51.999765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:14:52.000279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:14:52.000753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:14:52.001329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:14:52.001744 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:14:52.011201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:52.011652 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:52.012518 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:52.012980 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:52.031022 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Getting quotas for project afc824f35b8144398ace513ad018ec98. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:14:52.034909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Getting quotas for user db821aa375c2475181fd0c9d5807a51b and project afc824f35b8144398ace513ad018ec98. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:14:52.046504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:14:52.048835 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:14:52.154782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1c0ff54a-4c4c-4a29-98c4-0cc440298c9a tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 204 len: 0 microversion: 2.1 time: 0.395999 Jul 18 15:14:52.155492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 74/151] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:14:51 2022] DELETE /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:14:52.161259 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:52.162454 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:52.169573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:52.170199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:52.170325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7b77ac4a-42bb-4d33-bc95-3c89ff1f9c7a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551781 Jul 18 15:14:52.176041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 78/152] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:14:52.176226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:52.176226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:52.176438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:52.176910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:52.184257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:52.184729 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:52.185523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:52.185969 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:52.336541 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:52.343544 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9cf15abe-c712-49a7-9c22-3ba4f8917207 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.186023 Jul 18 15:14:52.344460 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 75/153] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:52 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:52.347540 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:52.357094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:52.360607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3ecd2dc-8717-46a8-8a44-d75e8d6a9d76 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:52.361239 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f3ecd2dc-8717-46a8-8a44-d75e8d6a9d76 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:52.362351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bafd1d2b-0f9f-4575-bae1-bc939e04b56e tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1553 microversion: 2.1 time: 0.190367 Jul 18 15:14:52.363172 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 79/154] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:52 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:52.421472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3ecd2dc-8717-46a8-8a44-d75e8d6a9d76 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:52.433805 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f3ecd2dc-8717-46a8-8a44-d75e8d6a9d76 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1214 microversion: 2.1 time: 0.077028 Jul 18 15:14:52.434950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 76/155] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:52 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:53.365754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:53.367695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:53.377807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:53.379311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:53.380430 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:53.382935 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:53.383986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:53.385267 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:53.391984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:53.392444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:53.393527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:53.394135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:53.558067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:53.570762 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a37fcb34-428d-4e84-99c6-692098a7c337 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1553 microversion: 2.1 time: 0.193097 Jul 18 15:14:53.571608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 77/156] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:53 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:53.577329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:53.578924 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:53.586021 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:53.586470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:53.587331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:53.587773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:53.636868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:53.645563 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7f51df16-fc79-4382-896a-2cd13f908558 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.285502 Jul 18 15:14:53.650831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 80/157] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:53 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:53.663300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:53.671305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e4627a29-7db0-41f4-86e3-5796e2f2a796 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1218 microversion: 2.1 time: 0.098326 Jul 18 15:14:53.671902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 78/158] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:53 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:54.588708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:54.594813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:54.596273 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:54.596770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:54.597554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:54.597991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:54.666633 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:54.667254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:54.673948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:54.679368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:54.680422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:54.681165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:54.772007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:54.779433 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-adabbbf7-2089-437c-bdf4-a6e80377fb3c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1553 microversion: 2.1 time: 0.194978 Jul 18 15:14:54.780729 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 81/159] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:54 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:54.795020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:54.795387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:54.802077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:54.802996 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:54.804395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:54.804841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:54.847620 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:54.858489 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab8a3ca4-b56b-4d1e-8e03-c924dc589f97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.196687 Jul 18 15:14:54.862579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 79/160] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:54 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:14:54.875774 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:54.887355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6d0a8fba-09e0-4150-a12c-b4a3776d28f1 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1218 microversion: 2.1 time: 0.104125 Jul 18 15:14:54.888306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 82/161] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:54 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:55.799620 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:55.800279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:55.815784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:55.816247 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:55.817064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:55.817514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:55.879840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:55.880956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:55.889292 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:55.889764 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:55.890682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:55.891337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:55.985847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:55.994986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a31d8c86-b20c-45a2-bfd8-d6f68f0113d4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1553 microversion: 2.1 time: 0.200308 Jul 18 15:14:55.995593 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 80/162] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:55 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:56.005781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:56.006403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:56.012929 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:56.013408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:56.014187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:56.014669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:56.061988 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:56.071119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-90c6238b-5929-47a8-9655-67decada977a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.196714 Jul 18 15:14:56.071767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 83/163] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:55 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:56.117817 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:56.125707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-003c06a1-78ad-4e16-9ffa-2a940d639c90 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1218 microversion: 2.1 time: 0.123934 Jul 18 15:14:56.126310 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 81/164] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:55 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:57.014483 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:57.015282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:57.023322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:57.023775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:57.024576 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:57.025450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:57.089728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:57.090429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:57.097727 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:57.098185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:57.099109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:57.100609 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:57.125134 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:14:57.185123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:57.196611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e3db32a9-b6c0-4465-bed6-e7200e5912e4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1553 microversion: 2.1 time: 0.186650 Jul 18 15:14:57.197290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 84/165] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:57 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:57.202703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:57.203964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:57.212616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:57.213083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:57.214054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:57.214528 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:57.297342 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:57.306399 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0a34dc04-2748-4b11-9270-4aa3e20d20d0 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1218 microversion: 2.1 time: 0.108015 Jul 18 15:14:57.307396 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 85/166] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:57 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:57.358890 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:57.371667 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-00051dd1-ec43-44bb-a30c-d87a48000e6f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.286085 Jul 18 15:14:57.372874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 82/167] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:57 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:58.226129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:58.226847 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:58.233752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.234208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.235018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.235627 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.324980 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:58.327018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:58.338632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.339374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.340591 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.341210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.398676 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:58.410786 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b7764054-f0db-467d-a42e-cf986a2d877c tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1553 microversion: 2.1 time: 0.199815 Jul 18 15:14:58.411187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 86/168] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:58 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:58.418164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:58.419241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:58.427896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.429227 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.430522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.431207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.447628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:58.483937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2cc75cb9-40ee-4dc0-8813-3a209b0567bd tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1266 microversion: 2.1 time: 0.164485 Jul 18 15:14:58.486287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 83/169] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:58 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:58.638324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:58.648312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-606f172e-bf61-4af1-b4ff-f01af78a11d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.234916 Jul 18 15:14:58.649990 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 87/170] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:58 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:58.935590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-343bde64-d36f-4119-b14d-9873ab46202c req-336115f0-7c84-4d79-805e-f7638b9579ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d00e830-cb20-495b-aaf9-4f6e480f6707", "name": "network-vif-deleted", "tag": "a9f26fc8-50d2-44ba-a47e-21fabea41b4e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:14:58.946742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-343bde64-d36f-4119-b14d-9873ab46202c req-336115f0-7c84-4d79-805e-f7638b9579ba service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:58.948625 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-343bde64-d36f-4119-b14d-9873ab46202c req-336115f0-7c84-4d79-805e-f7638b9579ba service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:58.998978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-343bde64-d36f-4119-b14d-9873ab46202c req-336115f0-7c84-4d79-805e-f7638b9579ba service nova] Creating event network-vif-deleted:a9f26fc8-50d2-44ba-a47e-21fabea41b4e for instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 on hv-cinder-83697 Jul 18 15:14:59.008130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-343bde64-d36f-4119-b14d-9873ab46202c req-336115f0-7c84-4d79-805e-f7638b9579ba service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076246 Jul 18 15:14:59.009659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 84/171] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:14:59.431012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:59.431559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:59.448628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:59.449955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:59.451241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:59.452000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:59.513685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:59.514455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:59.526736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:59.527652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:59.530245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:59.531437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:59.612271 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:59.629931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ecc0aa0b-9933-4b60-8738-4b05bf08bb80 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1346 microversion: 2.1 time: 0.203351 Jul 18 15:14:59.635525 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 88/172] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:59 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:59.668692 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:14:59.670800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:14:59.680862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:59.681734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:59.682855 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:14:59.683773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:14:59.819219 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:59.885760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7d34f6c4-01da-4db3-b278-f27aa394ec0a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1272 microversion: 2.1 time: 0.375065 Jul 18 15:14:59.886905 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 85/173] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:59 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1272 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:14:59.969702 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:14:59.978678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3e1a6d91-359b-4940-b000-652e790f5482 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.315542 Jul 18 15:14:59.988304 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 89/174] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:14:59 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:00.657883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:00.659788 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:00.668257 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:00.668825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:00.670944 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:00.671758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:00.720994 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:00.721513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:00.722014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lazy-loading 'fault' on Instance uuid 4d00e830-cb20-495b-aaf9-4f6e480f6707 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:15:00.852114 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de90974572419e906e7ac5d9d8292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a337533276641a2b556a55fdab4a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:00.867194 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-252cfa9b-2081-4274-85e4-5131d2eaf500 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 200 len: 1351 microversion: 2.1 time: 0.216308 Jul 18 15:15:00.867964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 86/175] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:00 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 1351 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:00.908200 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:00.911631 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:00.928516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:00.928516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:00.928516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:00.928516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:01.005274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:01.006937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:01.022683 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:01.023083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:01.023795 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:01.024892 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:01.025811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:01.035973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f21deab5-6ba7-4f04-b516-d6225cb8e037 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1272 microversion: 2.1 time: 0.132967 Jul 18 15:15:01.038299 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 90/176] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:00 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:01.342042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:01.353838 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-23682c0f-3575-4213-9fd3-9252f08a80c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.359542 Jul 18 15:15:01.357957 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 87/177] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:00 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:01.886593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:01.887727 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:01.895873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:01.897133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:01.898352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:01.898820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:01.918712 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] HTTP exception thrown: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Request method failure captured: Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 HTTP/1.1 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xinf0teS4pWU5zc7K-8TdEjVKKz9pyHRTrU7QquYAF3vDxGDJ-ismfNKSsUaoJ3PxMefhd5VM61k2__yF82ZeVtPSzfthPIWdhCquPGWjIj0mlnFEQeFw6YQsFskLz6i-0uTG_F4AyGa4vJ_DxogDhZ75x9qW6BgpXc0hDe1FXhff8 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:15:01.932325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9a337533276641a2b556a55fdab4a049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9a337533276641a2b556a55fdab4a049", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 21de90974572419e906e7ac5d9d8292d Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:01.933879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '4d00e830-cb20-495b-aaf9-4f6e480f6707'} Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:01.934756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:01.936041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:01.937529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Returning 404 to user: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:01.937529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7b37e309-84f8-4022-8c1e-009982a64be4 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 404 len: 111 microversion: 2.1 time: 0.049641 Jul 18 15:15:01.938334 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 91/178] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:01 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:02.058151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:02.058891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:02.069753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:02.071388 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:02.074679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:02.075780 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:02.076100 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:02.076234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:02.077166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:02.078285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:02.085126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:02.085944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:02.086849 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:02.087486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:02.107995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] HTTP exception thrown: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Request method failure captured: Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707/os-volume_attachments HTTP/1.1 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xinf0teS4pWU5zc7K-8TdEjVKKz9pyHRTrU7QquYAF3vDxGDJ-ismfNKSsUaoJ3PxMefhd5VM61k2__yF82ZeVtPSzfthPIWdhCquPGWjIj0mlnFEQeFw6YQsFskLz6i-0uTG_F4AyGa4vJ_DxogDhZ75x9qW6BgpXc0hDe1FXhff8 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:15:02.110709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9a337533276641a2b556a55fdab4a049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9a337533276641a2b556a55fdab4a049", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 21de90974572419e906e7ac5d9d8292d Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:02.112297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'server_id': '4d00e830-cb20-495b-aaf9-4f6e480f6707'} Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:02.113142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:02.114833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:02.118737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Returning 404 to user: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:02.119801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-05c28c86-9099-4eb1-a1ee-ddb867e87db1 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054958 Jul 18 15:15:02.126927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 92/179] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:15:02 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:15:02.367561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:02.374061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:02.374813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:02.384067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:02.384530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:02.385523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:02.386150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:02.387058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e5e0c5af-3bdc-45d2-ab2e-8da2d44c58c2 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.334437 Jul 18 15:15:02.388151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 88/180] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:02 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:02.610782 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:02.620606 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8a873a04-48fb-436d-a341-6edbb9c50e4c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.251429 Jul 18 15:15:02.621845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 93/181] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:02 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:03.405686 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:03.406786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:03.410490 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:03.415238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:03.415682 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:03.424453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:03.424921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:03.643217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:03.643976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:03.653625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:03.654490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:03.655528 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:03.660771 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:03.895532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:03.906371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-efa7cc27-1136-421d-96eb-90383a2aa6ef tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.269179 Jul 18 15:15:03.906371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 94/182] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:03 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:03.925300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:03.947996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e0493165-983e-4482-b58e-de11f061968b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.541530 Jul 18 15:15:03.948691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 89/183] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:03 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:04.637394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-867a5231-dd7b-4fc7-af10-e8be093042cf req-9724e268-296a-4e8d-a32c-e604d33c14aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7364fc4f-9026-4155-8f7c-59ff9c75f11e", "tag": "76cb54e4-0f3b-49a5-a80c-42c7d5bc2c1c"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:04.656967 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-867a5231-dd7b-4fc7-af10-e8be093042cf req-9724e268-296a-4e8d-a32c-e604d33c14aa service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.657751 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-867a5231-dd7b-4fc7-af10-e8be093042cf req-9724e268-296a-4e8d-a32c-e604d33c14aa service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.685336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-867a5231-dd7b-4fc7-af10-e8be093042cf req-9724e268-296a-4e8d-a32c-e604d33c14aa service nova] Creating event network-changed:76cb54e4-0f3b-49a5-a80c-42c7d5bc2c1c for instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e on hv-cinder-83697 Jul 18 15:15:04.692063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-867a5231-dd7b-4fc7-af10-e8be093042cf req-9724e268-296a-4e8d-a32c-e604d33c14aa service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058676 Jul 18 15:15:04.693070 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 95/184] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:04.751617 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:04.752381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:04.777697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.781259 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.782356 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.785809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.823046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] HTTP exception thrown: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Request method failure captured: Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 HTTP/1.1 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xinf0teS4pWU5zc7K-8TdEjVKKz9pyHRTrU7QquYAF3vDxGDJ-ismfNKSsUaoJ3PxMefhd5VM61k2__yF82ZeVtPSzfthPIWdhCquPGWjIj0mlnFEQeFw6YQsFskLz6i-0uTG_F4AyGa4vJ_DxogDhZ75x9qW6BgpXc0hDe1FXhff8 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:15:04.828610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9a337533276641a2b556a55fdab4a049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9a337533276641a2b556a55fdab4a049", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 21de90974572419e906e7ac5d9d8292d Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.830246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '4d00e830-cb20-495b-aaf9-4f6e480f6707'} Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:04.831111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.832416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.839070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Returning 404 to user: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:04.840074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-174feb10-0e85-4a82-adad-ad07a72ed731 tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 404 len: 111 microversion: 2.1 time: 0.096666 Jul 18 15:15:04.843381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 90/185] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:15:04 2022] DELETE /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:04.852151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:04.852890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] [instance: 4d00e830-cb20-495b-aaf9-4f6e480f6707] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:04.864345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.864727 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.875413 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.875413 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.903041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] HTTP exception thrown: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Request method failure captured: Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 HTTP/1.1 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xinf0teS4pWU5zc7K-8TdEjVKKz9pyHRTrU7QquYAF3vDxGDJ-ismfNKSsUaoJ3PxMefhd5VM61k2__yF82ZeVtPSzfthPIWdhCquPGWjIj0mlnFEQeFw6YQsFskLz6i-0uTG_F4AyGa4vJ_DxogDhZ75x9qW6BgpXc0hDe1FXhff8 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:15:04.904506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9a337533276641a2b556a55fdab4a049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9a337533276641a2b556a55fdab4a049", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9a337533276641a2b556a55fdab4a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 9a337533276641a2b556a55fdab4a049 Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050803331 Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 21de90974572419e906e7ac5d9d8292d Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-DeleteServersTestJSON-1050803331-project Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.905982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '4d00e830-cb20-495b-aaf9-4f6e480f6707'} Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:04.906722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. Jul 18 15:15:04.907927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:04.908984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] Returning 404 to user: Instance 4d00e830-cb20-495b-aaf9-4f6e480f6707 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:04.908984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a374eb91-b715-4c2b-a156-dd749e1d57ae tempest-DeleteServersTestJSON-1050803331 tempest-DeleteServersTestJSON-1050803331-project] 10.222.0.83 "GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707" status: 404 len: 111 microversion: 2.1 time: 0.059998 Jul 18 15:15:04.927381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:04.928226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:04.931176 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 96/186] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:04 2022] GET /compute/v2.1/servers/4d00e830-cb20-495b-aaf9-4f6e480f6707 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:04.937476 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.937846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.946884 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:04.960044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:04.984154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:04.984687 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:05.003446 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:05.003905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:05.004765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:05.005250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:05.457525 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:05.483651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-aa7a908a-3025-4ce3-b74a-a6cdcb1ca108 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.506736 Jul 18 15:15:05.497212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 97/187] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:04 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:05.538871 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:05.547886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-759ef777-96ef-4593-aeba-4f10a7588f25 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.624419 Jul 18 15:15:05.555391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 91/188] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:04 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:06.508851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:06.520192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:06.534740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:06.534740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:06.535810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:06.535810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:06.587511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:06.587511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:06.588887 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:06.589471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:06.590711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:06.591246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:06.982124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:06.999049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-640b3288-83a9-4b80-96b0-78dff8b67669 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.432469 Jul 18 15:15:07.000948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 92/189] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:06 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:07.139290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:07.153266 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-44fadfa3-2658-477a-80ef-82d37d864546 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.651701 Jul 18 15:15:07.154388 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 98/190] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:06 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:08.024173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:08.025153 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:08.027389 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:08.033250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:08.033716 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:08.035304 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:08.035976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:08.178217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:08.181433 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:08.202329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:08.203943 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:08.206881 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:08.208038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:08.218191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:08.354920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:08.371839 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b7b02b00-4c0d-4d7b-85f1-4061f33bb255 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.351789 Jul 18 15:15:08.381937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 93/191] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:08 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:08.608524 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:08.619450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8336684d-9a6f-4c38-89a6-be11cbcb97b8 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.450577 Jul 18 15:15:08.629893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 99/192] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:08 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:09.398047 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:09.400581 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:09.408996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:09.408996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:09.410290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:09.416128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:09.652128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:09.657507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:09.687969 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:09.688673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:09.690269 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:09.690988 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:09.857954 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:09.867724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c646bba2-4270-45c4-9719-2f86b946b55b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.481423 Jul 18 15:15:09.872027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 94/193] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:09 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:09.905592 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:09.914302 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dde65acd-0d4a-48ff-a3a6-d310e84cc4d6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.279720 Jul 18 15:15:09.915215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 100/194] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:09 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:10.890036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:10.891449 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:10.898705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:10.899522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:10.900661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:10.901089 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:10.940421 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:10.942146 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:10.952917 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:10.953437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:10.955150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:10.955601 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:11.287410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:11.295844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-202346b9-5dc5-4f85-8e07-9db361e7cd4b tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.367122 Jul 18 15:15:11.296688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 101/195] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:10 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:11.447220 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:11.457489 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-da3d03d1-848a-4801-8a11-66c9ae871718 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.574589 Jul 18 15:15:11.458414 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 95/196] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:10 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:12.319352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:12.320989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:12.323959 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:12.348391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:12.349291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:12.350971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:12.351963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:12.477343 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:12.478201 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:12.497077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:12.497906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:12.509060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:12.510210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:12.682862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:12.698476 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-eb8da4eb-d106-44be-ac40-9c931e613998 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.383935 Jul 18 15:15:12.710565 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 102/197] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:12 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:13.488396 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:13.515626 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-49e7c314-839e-4aa4-973b-6e5155be5903 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 1.041811 Jul 18 15:15:13.524585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 96/198] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:12 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:13.720428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:13.723077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:13.746319 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:13.747027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:13.747882 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:13.748335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:14.002828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:14.012925 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bc4da6c2-753c-4531-8319-544da9d2b53a tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.298811 Jul 18 15:15:14.013900 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 103/199] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:13 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:14.542813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:14.543680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:14.556951 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:14.557707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:14.558739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:14.559362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:14.841412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:14.852036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f6d65742-7985-46f4-904c-0282abbb1e41 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.313442 Jul 18 15:15:14.862898 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 97/200] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:14 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:15.041506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:15.044051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:15.057101 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:15.058057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:15.059054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:15.066465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:15.360468 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:15.393004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-26ead948-a605-4c40-9c01-5250c4ae2b4e tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.364912 Jul 18 15:15:15.406790 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 104/201] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:15 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:15.872171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:15.872857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:15.879085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:15.879535 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:15.880322 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:15.880763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:16.055770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:16.068066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-743c6071-f722-41ce-89b8-b32ceaf14245 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.199611 Jul 18 15:15:16.082072 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 98/202] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:15 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:16.416513 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:16.417353 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:16.431858 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:16.432361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:16.433305 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:16.433759 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:16.631441 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-d6db1d83-c7e2-41f8-9be7-92377baef3ed req-f01f6c1c-40c3-486b-a77b-ba16c5286018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7364fc4f-9026-4155-8f7c-59ff9c75f11e", "name": "network-vif-plugged", "status": "completed", "tag": "76cb54e4-0f3b-49a5-a80c-42c7d5bc2c1c"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:16.648034 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-d6db1d83-c7e2-41f8-9be7-92377baef3ed req-f01f6c1c-40c3-486b-a77b-ba16c5286018 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:16.648927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-d6db1d83-c7e2-41f8-9be7-92377baef3ed req-f01f6c1c-40c3-486b-a77b-ba16c5286018 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:16.685242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-d6db1d83-c7e2-41f8-9be7-92377baef3ed req-f01f6c1c-40c3-486b-a77b-ba16c5286018 service nova] Creating event network-vif-plugged:76cb54e4-0f3b-49a5-a80c-42c7d5bc2c1c for instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e on hv-cinder-83697 Jul 18 15:15:16.691749 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-d6db1d83-c7e2-41f8-9be7-92377baef3ed req-f01f6c1c-40c3-486b-a77b-ba16c5286018 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064319 Jul 18 15:15:16.695321 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 99/203] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:16.851141 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:16.870734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4cbe1a48-9e71-485f-b282-99ea460832ec tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.460659 Jul 18 15:15:16.883236 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 105/204] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:16 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:17.091437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:17.092927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:17.101303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:17.102040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:17.103428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:17.104090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:17.498486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:17.502879 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:17.513895 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-73fd3b69-396b-402d-9a3d-4bc38e66c40a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.426682 Jul 18 15:15:17.516821 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 100/205] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:17 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:17.894062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:17.894062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:17.901486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:17.902403 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:17.903394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:17.903854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:18.185895 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:18.199489 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-766cb8d8-be24-4c99-9e42-38b878f930d9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1314 microversion: 2.1 time: 0.313230 Jul 18 15:15:18.214176 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 106/206] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:17 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:18.245486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7d1622a5-b10d-44f8-bbdb-007119b27440 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Action: 'create', calling method: .version_select at 0x7f48c22c8ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-886797128"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:18.533819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:18.534456 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:18.545609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:18.546068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:18.555139 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:18.555589 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:18.892921 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:18.929144 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b38625d7-6dfd-47e5-812d-dea091b33fd5 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.398105 Jul 18 15:15:18.931291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 107/207] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:18 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:19.217822 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:19.219583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:19.227270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:19.228195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:19.229311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:19.229972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:19.456656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7d1622a5-b10d-44f8-bbdb-007119b27440 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.388156 Jul 18 15:15:19.456656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 101/208] 10.222.0.83 () {60 vars in 1154 bytes} [Mon Jul 18 15:15:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 15:15:19.467636 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2ff5ead3-eda6-4507-a13c-50ac4b0e4668 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c20e9310>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:19.581074 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:19.590716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-281fe469-cfab-4a84-b05a-e7f0c95d0cc7 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1464 microversion: 2.1 time: 0.376819 Jul 18 15:15:19.595191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 108/209] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:19 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:19.612756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2ff5ead3-eda6-4507-a13c-50ac4b0e4668 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 200 len: 344 microversion: 2.1 time: 0.146810 Jul 18 15:15:19.612756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 102/210] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:19 2022] GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 344 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:19.649149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:19.649733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:19.665375 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:19.666854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:19.668423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:19.669038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:19.711559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:15:19.952485 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:19.953118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:19.962682 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:19.963146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:19.978183 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:19.978963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:20.223050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c883dab2-12ce-40d9-9a61-1a5bdd632b89 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 204 len: 0 microversion: 2.1 time: 0.577218 Jul 18 15:15:20.224329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 109/211] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:15:19 2022] DELETE /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:15:20.240249 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:20.243784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:20.266843 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:20.269199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:20.270270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:20.279678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:20.479563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:20.494264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0d54345e-5eb0-4a5e-8a5a-c4cc56a3de9c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.545866 Jul 18 15:15:20.495039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 103/212] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:19 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:20.629325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-be140519-ce2c-4b1f-af75-6a40851fad37 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c20e99d0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:20.766132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-be140519-ce2c-4b1f-af75-6a40851fad37 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 200 len: 345 microversion: 2.1 time: 0.142069 Jul 18 15:15:20.770517 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 104/213] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:20 2022] GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:20.842796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2bdb6034-52b0-4212-8325-1b02cc60cf6d tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Action: 'create', calling method: .version_select at 0x7f48c20e9310>, body: {"snapshot": {"volume_id": "e1abaabd-5879-4e42-b019-1a45b662eecc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1769981978"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:20.981370 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:21.020777 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3e30a0c4-816f-4235-b68f-9d8cc430f9ba tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1470 microversion: 2.1 time: 0.789592 Jul 18 15:15:21.039517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 110/214] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:20 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1470 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:21.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:21.526771 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:21.537118 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:21.538906 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:21.540350 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:21.542634 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:21.883416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:21.893028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-29d3156b-fbfd-4428-9ddd-f7824125f1b0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.373516 Jul 18 15:15:21.893667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 111/215] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:21 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:22.022935 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2bdb6034-52b0-4212-8325-1b02cc60cf6d tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.236163 Jul 18 15:15:22.022935 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 105/216] 10.222.0.83 () {60 vars in 1161 bytes} [Mon Jul 18 15:15:20 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:22.034529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f931749d-416d-45ac-a31a-155e4829a54e tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c1797820>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:22.069429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:22.070389 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:22.091651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:22.093621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:22.096648 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:22.097921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:22.132320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f931749d-416d-45ac-a31a-155e4829a54e tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 287 microversion: 2.1 time: 0.102396 Jul 18 15:15:22.135076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 112/217] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:22 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:22.143320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-353eb38d-b66e-43d7-99c6-bb1136aa13f4 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c1a29280>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:22.245206 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-353eb38d-b66e-43d7-99c6-bb1136aa13f4 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.105855 Jul 18 15:15:22.251616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 113/218] 10.222.0.83 () {58 vars in 1139 bytes} [Mon Jul 18 15:15:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:22.276459 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-318442a3-1779-4aa0-8b47-94a1807afb56 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c191bf70>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:22.364870 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-318442a3-1779-4aa0-8b47-94a1807afb56 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 287 microversion: 2.1 time: 0.093369 Jul 18 15:15:22.373079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 114/219] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:22 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:22.694356 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:22.716174 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b2734cac-58bc-4c3f-bf2e-5932a05a8236 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1470 microversion: 2.1 time: 0.654143 Jul 18 15:15:22.741130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 106/220] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:22 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1470 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:22.915950 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:22.916810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:22.929407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:22.935562 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:22.939693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:22.940468 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:23.324888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:23.353852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b4b63085-0d8e-4470-acc2-8ea95ae5cbfc tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.443523 Jul 18 15:15:23.354698 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 115/221] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:22 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:23.385717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-40083bec-fa98-4ec7-8d8d-d74f7cc0acd9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c2047ee0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:23.446239 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-40083bec-fa98-4ec7-8d8d-d74f7cc0acd9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 287 microversion: 2.1 time: 0.065675 Jul 18 15:15:23.446894 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 107/222] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:23 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:23.624481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-ed593c6a-297f-4291-bb82-a67725a61c83 req-5e6826ed-ea37-420b-a385-99c7e14c15f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7364fc4f-9026-4155-8f7c-59ff9c75f11e", "name": "network-vif-deleted", "tag": "76cb54e4-0f3b-49a5-a80c-42c7d5bc2c1c"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:23.646065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-ed593c6a-297f-4291-bb82-a67725a61c83 req-5e6826ed-ea37-420b-a385-99c7e14c15f6 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:23.646923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-ed593c6a-297f-4291-bb82-a67725a61c83 req-5e6826ed-ea37-420b-a385-99c7e14c15f6 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:23.680596 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-ed593c6a-297f-4291-bb82-a67725a61c83 req-5e6826ed-ea37-420b-a385-99c7e14c15f6 service nova] Creating event network-vif-deleted:76cb54e4-0f3b-49a5-a80c-42c7d5bc2c1c for instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e on hv-cinder-83697 Jul 18 15:15:23.694867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-ed593c6a-297f-4291-bb82-a67725a61c83 req-5e6826ed-ea37-420b-a385-99c7e14c15f6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077540 Jul 18 15:15:23.714274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 116/223] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:23.752230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:23.753597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:23.769844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:23.770501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:23.771581 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:23.772655 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:23.907692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:23.917014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d337b23a-b487-4cb8-86ce-39223bdced94 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1428 microversion: 2.1 time: 0.168906 Jul 18 15:15:23.943246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 108/224] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:23 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1428 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:24.413228 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:24.414344 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:24.449833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:24.449833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:24.451010 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:24.451768 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:24.469649 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b7b8a14d-6c67-4a64-8045-de2fb7b8e6fd tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c20474c0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:24.613062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b7b8a14d-6c67-4a64-8045-de2fb7b8e6fd tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 287 microversion: 2.1 time: 0.150759 Jul 18 15:15:24.620370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 109/225] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:24 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:24.834058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:24.838958 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:24.844412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-944a9ad2-6fa7-44c1-92cd-cfc575fbc5dd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.471997 Jul 18 15:15:24.845710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 117/226] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:24 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:24.971443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:24.971443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:24.971443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:24.971443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:24.971910 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:24.971910 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:25.096014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:25.105541 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-37d74a02-5de0-4ccd-bd30-21856b24c8c9 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1428 microversion: 2.1 time: 0.153508 Jul 18 15:15:25.106200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 110/227] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:24 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1428 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:25.630870 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f327d899-ed93-4c1c-9c09-5cc6461f558b tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c19ed310>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:25.665200 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f327d899-ed93-4c1c-9c09-5cc6461f558b tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 287 microversion: 2.1 time: 0.038264 Jul 18 15:15:25.666136 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 118/228] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:25 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:25.889678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:25.889678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:25.894571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:25.895076 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:25.895885 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:25.898465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:26.097829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:26.112373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-47c22a97-b146-412f-9668-c8efb4b356e9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.247187 Jul 18 15:15:26.113590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 111/229] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:25 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:26.145196 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:26.147575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:26.160476 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:26.165723 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:26.167827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:26.169342 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:26.271949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:26.281587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4a214e59-838d-4ec4-b83f-33d2961a0496 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1299 microversion: 2.1 time: 0.153291 Jul 18 15:15:26.282213 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 119/230] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:26 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:26.458854 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:26.459403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:26.476229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:26.476798 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:26.477879 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:26.482457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:26.534317 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f469959c-09ea-4618-8de8-b4747100a6f6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/ips" status: 200 len: 146 microversion: 2.1 time: 0.079496 Jul 18 15:15:26.542822 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 112/231] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:15:26 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/ips => generated 146 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:26.685234 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-79082a3c-2bc6-44f4-b07f-72bbe7a47339 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c3b5ba60>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:26.789220 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-79082a3c-2bc6-44f4-b07f-72bbe7a47339 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 288 microversion: 2.1 time: 0.114792 Jul 18 15:15:26.790041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 120/232] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:26 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 288 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:26.801993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b7fb2487-a78e-4153-aad7-8b9d08e67449 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c20e9280>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:27.096059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b7fb2487-a78e-4153-aad7-8b9d08e67449 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 202 len: 0 microversion: 2.1 time: 0.299255 Jul 18 15:15:27.102608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 113/233] 10.222.0.83 () {58 vars in 1253 bytes} [Mon Jul 18 15:15:26 2022] DELETE /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:15:27.108638 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a58fdec4-6590-4cd5-b75a-d3fc52a010b8 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c18d05e0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:27.155098 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:27.155098 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:27.155407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a58fdec4-6590-4cd5-b75a-d3fc52a010b8 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 200 len: 287 microversion: 2.1 time: 0.050022 Jul 18 15:15:27.155407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 121/234] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:27 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:27.164917 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:27.165558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:27.166488 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:27.167071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:27.307600 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:27.308496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:27.325400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:27.330335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:27.331561 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:27.332678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:27.414345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:27.419597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:27.420197 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lazy-loading 'fault' on Instance uuid 7364fc4f-9026-4155-8f7c-59ff9c75f11e {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:15:27.477299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:27.488747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-70dae199-c5ce-4c66-ae01-dd59d423b28d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.341277 Jul 18 15:15:27.491528 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 114/235] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:27 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:27.536634 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db821aa375c2475181fd0c9d5807a51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc824f35b8144398ace513ad018ec98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:27.548744 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c1ffcd41-c9b6-4682-b192-43036dcec6c6 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 200 len: 1304 microversion: 2.1 time: 0.251864 Jul 18 15:15:27.549913 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 122/236] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:27 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:28.168374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7bb2281-0c33-4fb2-aba0-bb236fd38688 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c20e90d0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:28.209714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-e7bb2281-0c33-4fb2-aba0-bb236fd38688 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] HTTP exception thrown: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7bb2281-0c33-4fb2-aba0-bb236fd38688 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Request method failure captured: Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 HTTP/1.1 Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XkFU3TqXulBQl7j8Hkv0e-71tCvdXYSNocoeyp3Ya7SUmLKJ_tMGkMLPQErn3F_WClItntQ3NyFkNFQBQMr7fD2amWWsGbj2ZcB_tUNAg6CxMGUGy1qRDFS8WmtXsBEe5zsfvTHCpWAu7zpNgT7R6xo9qEtrPuvqB_YAoTqILC21lc Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:15:28.217167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3087891c94f34fc2a6234f04c03f27e0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 6c85cf89ac304a9caeac72b5805d0dfc Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '981b5612-9785-4f03-a52f-c3f21babd240'} Jul 18 15:15:28.219675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. (HTTP 404) (Request-ID: req-f0412719-4cd5-4f96-a23c-528c562d0616) Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.221197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:28.223360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 15:15:28.226180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. Jul 18 15:15:28.232947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.234834 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7bb2281-0c33-4fb2-aba0-bb236fd38688 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Returning 404 to user: Snapshot 981b5612-9785-4f03-a52f-c3f21babd240 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:28.236564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e7bb2281-0c33-4fb2-aba0-bb236fd38688 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240" status: 404 len: 111 microversion: 2.1 time: 0.071454 Jul 18 15:15:28.240193 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 115/237] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:15:28 2022] GET /compute/v2.1/os-snapshots/981b5612-9785-4f03-a52f-c3f21babd240 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:28.249103 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-34a9b6f0-5f0c-43c6-adbf-51b807a0bb6b tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c191b940>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:28.512132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:28.514092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:28.520573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:28.521342 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:28.523124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:28.523580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:28.575623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-34a9b6f0-5f0c-43c6-adbf-51b807a0bb6b tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 202 len: 0 microversion: 2.1 time: 0.333043 Jul 18 15:15:28.576238 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 123/238] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:15:28 2022] DELETE /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:15:28.581781 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:28.582446 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] [instance: 7364fc4f-9026-4155-8f7c-59ff9c75f11e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:28.605171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:28.618771 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:28.621313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:28.622465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:28.654142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] HTTP exception thrown: Instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e could not be found. Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Request method failure captured: Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e HTTP/1.1 Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XjpzLwYR5ulpihgmzWZb4W0ZO9vEOmeeamO87gxWNW3J5Eqy0iAGapafo8HBPY1OMYjpIhaBs88YLing5KY39Ssi7pGYqbwkW0ZKdYQJdlFogqHRnH-UhWk35Wk_xC4ghAMzr74KG7ei0WYqL2Lt2UuZNmmLebD-VI34LCILqrpLUk Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: afc824f35b8144398ace513ad018ec98 Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesNegativeTest-228062336 Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:15:28.662320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/afc824f35b8144398ace513ad018ec98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/afc824f35b8144398ace513ad018ec98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_afc824f35b8144398ace513ad018ec98", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/afc824f35b8144398ace513ad018ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesNegativeTest-228062336 Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: afc824f35b8144398ace513ad018ec98 Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesNegativeTest-228062336 Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesNegativeTest-228062336-project Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: db821aa375c2475181fd0c9d5807a51b Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesNegativeTest-228062336-project Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e could not be found. Jul 18 15:15:28.665611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '7364fc4f-9026-4155-8f7c-59ff9c75f11e'} Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e could not be found. Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:28.677361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e could not be found. Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e could not be found. Jul 18 15:15:28.680531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:28.690750 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] Returning 404 to user: Instance 7364fc4f-9026-4155-8f7c-59ff9c75f11e could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:28.690750 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-12ad1a06-f91f-4aaa-9780-d1a457564c51 tempest-VolumesNegativeTest-228062336 tempest-VolumesNegativeTest-228062336-project] 10.222.0.83 "GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e" status: 404 len: 111 microversion: 2.1 time: 0.087817 Jul 18 15:15:28.690750 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 124/239] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:28 2022] GET /compute/v2.1/servers/7364fc4f-9026-4155-8f7c-59ff9c75f11e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:28.690750 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fa9c2610-2a9a-4dc2-8fa4-71569fb42978 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c182c1f0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:28.752836 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fa9c2610-2a9a-4dc2-8fa4-71569fb42978 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 200 len: 344 microversion: 2.1 time: 0.083791 Jul 18 15:15:28.753789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 125/240] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:28 2022] GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:28.809597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:28.832634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8351e013-5ee9-45fa-b3d3-a4a99937e633 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1522 microversion: 2.1 time: 0.324736 Jul 18 15:15:28.833842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 116/241] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:28 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:29.770473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8e20e8de-1ef2-49bf-8dfa-dd7e3c1614f9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c18bdaf0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:29.806571 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-8e20e8de-1ef2-49bf-8dfa-dd7e3c1614f9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] HTTP exception thrown: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8e20e8de-1ef2-49bf-8dfa-dd7e3c1614f9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Request method failure captured: Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc HTTP/1.1 Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XkFU3TqXulBQl7j8Hkv0e-71tCvdXYSNocoeyp3Ya7SUmLKJ_tMGkMLPQErn3F_WClItntQ3NyFkNFQBQMr7fD2amWWsGbj2ZcB_tUNAg6CxMGUGy1qRDFS8WmtXsBEe5zsfvTHCpWAu7zpNgT7R6xo9qEtrPuvqB_YAoTqILC21lc Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:15:29.810442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3087891c94f34fc2a6234f04c03f27e0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 6c85cf89ac304a9caeac72b5805d0dfc Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': 'e1abaabd-5879-4e42-b019-1a45b662eecc'} Jul 18 15:15:29.812343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. (HTTP 404) (Request-ID: req-4956245e-2fa0-47a1-9fc5-1199398df05c) Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.813352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:29.814946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 15:15:29.816707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8e20e8de-1ef2-49bf-8dfa-dd7e3c1614f9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Returning 404 to user: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8e20e8de-1ef2-49bf-8dfa-dd7e3c1614f9 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 404 len: 109 microversion: 2.1 time: 0.047537 Jul 18 15:15:29.817994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 126/242] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:29 2022] GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:29.824533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7cfdcac9-cfa0-4184-a198-a1e3f5b58ea6 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c2047e50>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:29.856826 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-7cfdcac9-cfa0-4184-a198-a1e3f5b58ea6 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] HTTP exception thrown: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7cfdcac9-cfa0-4184-a198-a1e3f5b58ea6 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Request method failure captured: Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc HTTP/1.1 Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XkFU3TqXulBQl7j8Hkv0e-71tCvdXYSNocoeyp3Ya7SUmLKJ_tMGkMLPQErn3F_WClItntQ3NyFkNFQBQMr7fD2amWWsGbj2ZcB_tUNAg6CxMGUGy1qRDFS8WmtXsBEe5zsfvTHCpWAu7zpNgT7R6xo9qEtrPuvqB_YAoTqILC21lc Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:15:29.862146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3087891c94f34fc2a6234f04c03f27e0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 6c85cf89ac304a9caeac72b5805d0dfc Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': 'e1abaabd-5879-4e42-b019-1a45b662eecc'} Jul 18 15:15:29.866566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. (HTTP 404) (Request-ID: req-111fe24e-9ff1-490c-b74d-009874dbf93a) Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.868010 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 15:15:29.870327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 15:15:29.872622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.875084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.876226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:29.876369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7cfdcac9-cfa0-4184-a198-a1e3f5b58ea6 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Returning 404 to user: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:29.876369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7cfdcac9-cfa0-4184-a198-a1e3f5b58ea6 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 404 len: 109 microversion: 2.1 time: 0.044302 Jul 18 15:15:29.876596 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:29.876739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 117/243] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:15:29 2022] DELETE /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:29.876864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:29.876864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:29.876864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:29.877225 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:29.879384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7d67463-2a1b-4534-9678-fe8a131dc325 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Calling method '.version_select at 0x7f48c20118b0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:29.911717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-d7d67463-2a1b-4534-9678-fe8a131dc325 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] HTTP exception thrown: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7d67463-2a1b-4534-9678-fe8a131dc325 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Request method failure captured: Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc HTTP/1.1 Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XkFU3TqXulBQl7j8Hkv0e-71tCvdXYSNocoeyp3Ya7SUmLKJ_tMGkMLPQErn3F_WClItntQ3NyFkNFQBQMr7fD2amWWsGbj2ZcB_tUNAg6CxMGUGy1qRDFS8WmtXsBEe5zsfvTHCpWAu7zpNgT7R6xo9qEtrPuvqB_YAoTqILC21lc Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:15:29.914344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3087891c94f34fc2a6234f04c03f27e0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3087891c94f34fc2a6234f04c03f27e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 3087891c94f34fc2a6234f04c03f27e0 Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756713992 Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 6c85cf89ac304a9caeac72b5805d0dfc Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756713992-project Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': 'e1abaabd-5879-4e42-b019-1a45b662eecc'} Jul 18 15:15:29.916612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. (HTTP 404) (Request-ID: req-6f87b28a-38bb-48ef-bc19-ab66ad6797e1) Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.917530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:29.918950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 15:15:29.920926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7d67463-2a1b-4534-9678-fe8a131dc325 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] Returning 404 to user: Volume e1abaabd-5879-4e42-b019-1a45b662eecc could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d7d67463-2a1b-4534-9678-fe8a131dc325 tempest-VolumesSnapshotsTestJSON-756713992 tempest-VolumesSnapshotsTestJSON-756713992-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc" status: 404 len: 109 microversion: 2.1 time: 0.042681 Jul 18 15:15:29.922437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 118/244] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:29 2022] GET /compute/v2.1/os-volumes/e1abaabd-5879-4e42-b019-1a45b662eecc => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:30.054069 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:30.065454 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9092c61a-9c1c-47eb-96b9-3108debf33b6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1502 microversion: 2.1 time: 0.212059 Jul 18 15:15:30.066063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 127/245] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:29 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:30.083361 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:30.083991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:30.090605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:30.091067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:30.092071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:30.092510 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:30.283803 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:30.292508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c626a67-71bc-4aa5-a133-c49a55f99096 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1516 microversion: 2.1 time: 0.213019 Jul 18 15:15:30.293123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 119/246] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:30 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:32.816268 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:32.818789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:32.834801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:32.834801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:32.845263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:32.849649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:32.962240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lazy-loading 'flavor' on Instance uuid 541110c4-7284-457c-8298-e2235b1cb050 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:15:33.679749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f75d0117-f445-4326-886a-73c6fcb06c58 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/action" status: 200 len: 32 microversion: 2.1 time: 0.858864 Jul 18 15:15:33.699723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:33.701331 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 128/247] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:15:32 2022] POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/action => generated 32 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:15:33.705377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:33.731218 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:33.734080 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:33.750695 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:33.750695 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:33.775938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "365074e3-0536-4633-9173-c70e1fb366a2"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:33.780297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:33.798296 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:33.804300 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:33.806477 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:33.807276 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:34.513687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:34.573525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-089da15f-fbe1-4377-8444-b46a4a9b3599 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.882469 Jul 18 15:15:34.575735 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 120/248] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:33 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:35.201112 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ddeede67-87d6-4757-8a16-fa700fb6c676 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Action: 'create', calling method: .version_select at 0x7f48c20e95e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-896844593", "metadata": {"Type": "work"}}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:36.049427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-49a33958-2483-4396-82da-48dd247b48f9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.281172 Jul 18 15:15:36.049427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 129/249] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:15:33 2022] POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-volume_attachments => generated 194 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:36.057609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:36.058328 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:36.077703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:36.080651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:36.080651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:36.080651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:36.285266 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:36.295085 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1f67edd7-0f53-4228-8a9c-e287df92042e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.243725 Jul 18 15:15:36.296171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 130/250] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:36 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:37.147181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a2483104-56ed-463d-a617-a7178d622742 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Action: 'create', calling method: .version_select at 0x7f48c18c7af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1941132642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKS4VDwk6xP1UuPh5wuCXcDWrf+xwaX2cydgokpJS1wqcBoGadRHtljUAWNub5YN6982v2Xe6J87s6TonGvYP484BeiZGpsdr36aWddYPBi+FG9wuIz4hHD6+0DyCsi3w=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:37.163391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-a2483104-56ed-463d-a617-a7178d622742 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Getting quotas for project eb8e493ee52b4c2686d5010eed312191. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:15:37.167421 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-a2483104-56ed-463d-a617-a7178d622742 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Getting quotas for user 45b1df340f8a4102adf5f680d7e64139 and project eb8e493ee52b4c2686d5010eed312191. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:15:37.292392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ddeede67-87d6-4757-8a16-fa700fb6c676 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.430483 Jul 18 15:15:37.294772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 121/251] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Jul 18 15:15:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2434 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 15:15:37.306138 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b323da06-6782-4b8e-b460-372f5a677558 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Calling method '.version_select at 0x7f48c20f1430>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:37.398519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a2483104-56ed-463d-a617-a7178d622742 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.255294 Jul 18 15:15:37.399811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 131/252] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:15:37 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:37.409642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:37.410770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:37.418910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:37.419531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:37.420790 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:37.421230 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:37.437551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b323da06-6782-4b8e-b460-372f5a677558 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6" status: 200 len: 352 microversion: 2.1 time: 0.134793 Jul 18 15:15:37.439378 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 122/253] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:37 2022] GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:37.621873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:37.633497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d7cdfcaf-da48-42c2-8a6d-f6d5fa0ad83f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.232401 Jul 18 15:15:37.634978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 132/254] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:37 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:37.683717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2128197331", "imageRef": "010262e8-f5f3-4d77-a18d-fe54062aa55d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1941132642", "networks": [{"uuid": "4085d412-7a23-4eb8-b121-8902f61d9e2a"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:37.748633 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] validate_networks() for [('4085d412-7a23-4eb8-b121-8902f61d9e2a', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:15:38.268674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:15:38.269107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:15:38.269590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:15:38.269999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:15:38.270417 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:15:38.281054 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:38.281511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:38.282324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:38.282831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:38.300343 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Getting quotas for project eb8e493ee52b4c2686d5010eed312191. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:15:38.305883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Getting quotas for user 45b1df340f8a4102adf5f680d7e64139 and project eb8e493ee52b4c2686d5010eed312191. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:15:38.322558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:15:38.325257 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='010262e8-f5f3-4d77-a18d-fe54062aa55d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:15:38.463401 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3e4cc50d-3887-4599-8368-060414a7e955 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Calling method '.version_select at 0x7f48c16e3280>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:38.593721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-333ec1bb-a46f-44f3-9d78-cbd052b287ca tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914436 Jul 18 15:15:38.594869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 123/255] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:15:38.612076 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ba8fed4b-1468-4344-8bf5-1c24dc57bf0f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:38.613355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ba8fed4b-1468-4344-8bf5-1c24dc57bf0f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:38.673411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3e4cc50d-3887-4599-8368-060414a7e955 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6" status: 200 len: 353 microversion: 2.1 time: 0.226019 Jul 18 15:15:38.682824 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 133/256] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:38 2022] GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 => generated 353 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:15:38.688751 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:38.702038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:38.702038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:38.702038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:38.702038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:38.704575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:38.728250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ba8fed4b-1468-4344-8bf5-1c24dc57bf0f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:38.743149 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ba8fed4b-1468-4344-8bf5-1c24dc57bf0f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1259 microversion: 2.1 time: 0.140000 Jul 18 15:15:38.745402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 124/257] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:38 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:38.771632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-915bc5d6-c11f-4761-82a9-abcbd7911195 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Calling method '.version_select at 0x7f48c2047ee0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:38.879974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-915bc5d6-c11f-4761-82a9-abcbd7911195 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6" status: 200 len: 353 microversion: 2.1 time: 0.122801 Jul 18 15:15:38.884141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 125/258] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:38 2022] GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:38.893083 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83a9a7a8-bd98-4fd1-9288-3821ac0b16ad tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Calling method '.version_select at 0x7f48c21e7c10>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:38.898558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:38.907907 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-edebb125-7054-481b-a60b-729f0c7b440a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.223660 Jul 18 15:15:38.908511 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 134/259] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:38 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:39.492610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-83a9a7a8-bd98-4fd1-9288-3821ac0b16ad tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6" status: 202 len: 0 microversion: 2.1 time: 0.607255 Jul 18 15:15:39.494044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 126/260] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:15:38 2022] DELETE /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:15:39.502699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9287e321-0a3e-490c-8d3a-665e14e0ae63 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Calling method '.version_select at 0x7f48c16e38b0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:39.617439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9287e321-0a3e-490c-8d3a-665e14e0ae63 tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6" status: 200 len: 352 microversion: 2.1 time: 0.118980 Jul 18 15:15:39.618186 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 135/261] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:39 2022] GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:39.765464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9438b7d-18fc-4ed9-aa1e-254c025724b2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:39.765464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9438b7d-18fc-4ed9-aa1e-254c025724b2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:39.768728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:39.830793 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9438b7d-18fc-4ed9-aa1e-254c025724b2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:39.839122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9438b7d-18fc-4ed9-aa1e-254c025724b2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1259 microversion: 2.1 time: 0.079335 Jul 18 15:15:39.839736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 127/262] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:39 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:39.937744 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:39.938393 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:39.946318 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:39.947187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:39.949670 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:39.950174 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:40.172800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:40.182880 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-101b5486-3f87-427a-ad12-47ea2e431713 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.249116 Jul 18 15:15:40.183479 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 136/263] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:39 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:40.630036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fe4e4350-096e-4667-8a1f-5639f80baefd tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Calling method '.version_select at 0x7f48c20e9ca0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:40.667243 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-fe4e4350-096e-4667-8a1f-5639f80baefd tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] HTTP exception thrown: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fe4e4350-096e-4667-8a1f-5639f80baefd tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Request method failure captured: Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 HTTP/1.1 Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XkWGdyb1Ou8Y5dFlOzzx1vgyfxNBchyhpjVkx7k6a9LhLVNhTu8zYP07ASpHdQWk49P6MSVlvsyTEGb8w-xmJUYhQHi5gGBrbGmfSpqO1jRUUHLv-Q1KcOLTgDHvQGgBOzsVy9NW7_bn0xKaiyKvNxicB56mWUA9Lsw6rIn8l42rhg Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: ee222427448b437d84d5ba9b19ec3afc Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesGetTestJSON-83076659 Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:15:40.669845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ee222427448b437d84d5ba9b19ec3afc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ee222427448b437d84d5ba9b19ec3afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ee222427448b437d84d5ba9b19ec3afc", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ee222427448b437d84d5ba9b19ec3afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesGetTestJSON-83076659 Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: ee222427448b437d84d5ba9b19ec3afc Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesGetTestJSON-83076659 Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesGetTestJSON-83076659-project Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 28b2d2ba51ea4e9f934403fc089fe96e Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesGetTestJSON-83076659-project Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '809bd931-566d-4463-972f-f05aaf02bcf6'} Jul 18 15:15:40.671642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. (HTTP 404) (Request-ID: req-bbbaecbb-c812-4bd1-954d-73139317f142) Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:40.672451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:15:40.673867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 15:15:40.675238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fe4e4350-096e-4667-8a1f-5639f80baefd tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] Returning 404 to user: Volume 809bd931-566d-4463-972f-f05aaf02bcf6 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fe4e4350-096e-4667-8a1f-5639f80baefd tempest-VolumesGetTestJSON-83076659 tempest-VolumesGetTestJSON-83076659-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6" status: 404 len: 109 microversion: 2.1 time: 0.046082 Jul 18 15:15:40.676407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 128/264] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:15:40 2022] GET /compute/v2.1/os-volumes/809bd931-566d-4463-972f-f05aaf02bcf6 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:15:40.868149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:40.868895 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:40.879035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:40.879877 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:40.882613 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:40.883095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:40.967644 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:40.978883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-577a79b4-72ed-4fbd-b005-83e6af3515d8 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1263 microversion: 2.1 time: 0.116717 Jul 18 15:15:40.979735 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 137/265] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:40 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1263 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:41.201863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:41.202638 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:41.210801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:41.211277 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:41.212108 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:41.212816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:41.369469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:41.370450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:41.383435 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:41.384383 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:41.385952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:41.387478 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:41.464961 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7b6477b3-a663-4554-9883-a7f47d5ea785 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/ips" status: 200 len: 151 microversion: 2.20 time: 0.103448 Jul 18 15:15:41.464961 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 138/266] 10.222.0.83 () {60 vars in 1288 bytes} [Mon Jul 18 15:15:41 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/ips => generated 151 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:15:41.480651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:41.497108 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-896a6131-91f9-4e41-8451-64d712a7ba24 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.299931 Jul 18 15:15:41.498100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 129/267] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:41 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:42.003685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:42.004532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:42.020412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:42.021189 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:42.022336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:42.023108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:42.126036 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:42.135609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-481ae85f-7767-46a0-8d97-02832bedaf26 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1311 microversion: 2.1 time: 0.135947 Jul 18 15:15:42.136195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 139/268] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:41 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:42.525565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:42.526343 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:42.538963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:42.540856 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:42.541811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:42.542462 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:42.754379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:42.768267 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5b48853a-ad77-466e-85a0-d82044279cd3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.256544 Jul 18 15:15:42.769401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 130/269] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:42 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:43.154003 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:43.154665 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:43.166788 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:43.170801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:43.171270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:43.172440 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:43.176784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:43.304419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:43.307825 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:43.315111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-14dc7030-3a12-4453-9d67-fd859fc89149 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1319 microversion: 2.1 time: 0.165550 Jul 18 15:15:43.326643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 140/270] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:43 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:43.788962 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:43.789643 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:43.809127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:43.809918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:43.811144 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:43.811930 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:44.263647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:44.264979 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:44.280010 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:44.293161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:44.302798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:44.304359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:44.304819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:44.320330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5cd7cdb0-1c6a-48ea-a1b8-e955c5cf6212 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.536753 Jul 18 15:15:44.324402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 131/271] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:43 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:44.343346 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-872ad01c-81f4-4f1e-81a4-9447730b3270 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:44.358896 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-872ad01c-81f4-4f1e-81a4-9447730b3270 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:44.363374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-872ad01c-81f4-4f1e-81a4-9447730b3270 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:44.402351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lazy-loading 'flavor' on Instance uuid 2e422edc-5603-4ed9-8572-d40f50f25155 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:15:44.483066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-872ad01c-81f4-4f1e-81a4-9447730b3270 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Going to try to stop instance {{(pid=118340) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 15:15:44.813726 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-872ad01c-81f4-4f1e-81a4-9447730b3270 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action" status: 202 len: 0 microversion: 2.1 time: 0.487775 Jul 18 15:15:44.814441 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 132/272] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:15:44 2022] POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:15:44.821459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:44.822578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:44.830069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:44.830731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:44.831946 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:44.832684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:45.598288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1ca49931-80e1-495f-8b1b-9912b3fd8002 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/action" status: 202 len: 0 microversion: 2.20 time: 1.338900 Jul 18 15:15:45.598288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 141/273] 10.222.0.83 () {62 vars in 1318 bytes} [Mon Jul 18 15:15:44 2022] POST /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/action => generated 0 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 15:15:45.624057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1954183782", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "networks": [{"uuid": "4743e396-953c-45ec-b3dc-6d088fb921fa"}]}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:45.748868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] validate_networks() for [('4743e396-953c-45ec-b3dc-6d088fb921fa', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:15:45.749870 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:45.763779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ea1551ce-04f1-4c16-b418-f0a93660aa8e tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.943707 Jul 18 15:15:45.763779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 133/274] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:44 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:45.776013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:45.776648 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:45.801396 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:45.801396 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:45.801396 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:45.801396 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:45.837089 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:46.641914 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:15:46.642506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:15:46.643120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:15:46.643543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:15:46.643968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:15:46.663425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:46.664174 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:46.665203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:46.671733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:46.705085 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Getting quotas for project 43a5c5beef1a42f0ac47a1f540e55c21. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:15:46.710970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Getting quotas for user faa3eace09844298a4cf0373ddc74de1 and project 43a5c5beef1a42f0ac47a1f540e55c21. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:15:46.726825 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:15:46.730312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:15:46.889811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:46.908901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-478289f9-3a31-4f31-b280-d3921083c221 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.307385 Jul 18 15:15:46.913536 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 142/275] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:15:46.922862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0a4bc649-c128-4085-a209-5ef1594b6cc9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 1.157888 Jul 18 15:15:46.923482 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 134/276] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:45 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:46.934753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:46.934753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:46.937013 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:46.937486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:46.938382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:46.938860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:46.957102 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:46.957725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:46.966610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:46.976060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:46.976060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:46.976060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:47.268699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:47.282350 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7793f664-9752-447a-bb7a-6d90dc3dc2f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.367311 Jul 18 15:15:47.282939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:47.294605 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 143/277] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:46 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:47.297284 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:47.299219 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:47.300774 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:47.301768 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d6339ccb-c516-46db-9a92-43112fead66d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.350848 Jul 18 15:15:47.302098 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:47.302894 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 135/278] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:46 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:47.309906 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:47.310453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54beee6b-f1c5-4185-8622-c2c4f19a5a85 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:47.310920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:47.311126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-54beee6b-f1c5-4185-8622-c2c4f19a5a85 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:47.312019 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:47.313177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:47.427793 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54beee6b-f1c5-4185-8622-c2c4f19a5a85 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:47.448015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54beee6b-f1c5-4185-8622-c2c4f19a5a85 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1214 microversion: 2.1 time: 0.143155 Jul 18 15:15:47.448638 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 136/279] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:47 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1214 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:47.462511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-03870512-a61d-477a-abf8-0c06fc7b93b1 req-e6f7a2c9-b736-4276-bf73-faf4eda4c05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:47.489260 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-03870512-a61d-477a-abf8-0c06fc7b93b1 req-e6f7a2c9-b736-4276-bf73-faf4eda4c05e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:47.490027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-03870512-a61d-477a-abf8-0c06fc7b93b1 req-e6f7a2c9-b736-4276-bf73-faf4eda4c05e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:47.520687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-03870512-a61d-477a-abf8-0c06fc7b93b1 req-e6f7a2c9-b736-4276-bf73-faf4eda4c05e service nova] Creating event network-changed:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:15:47.533126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-03870512-a61d-477a-abf8-0c06fc7b93b1 req-e6f7a2c9-b736-4276-bf73-faf4eda4c05e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078982 Jul 18 15:15:47.541523 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 137/280] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:47.845552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:47.858060 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1c9e0be8-df9a-4926-bc89-58696551b91d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.561961 Jul 18 15:15:47.871543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 144/281] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:47 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:47.957632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:47.961321 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:47.998207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:48.001313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:48.002357 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:48.010651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:48.291193 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:48.303979 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:48.304833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:48.320413 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:48.324057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:48.326280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:48.328190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:48.810198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:48.829855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8d500e42-3d1b-4a47-99f1-121b3a87b37c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.891432 Jul 18 15:15:48.830869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 138/282] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:47 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:48.836045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:48.839653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:48.851161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:48.851891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:48.852714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:48.853166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:49.313137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:49.326436 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-017d4a39-68d8-4066-af9d-787485ebbe02 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 1.027373 Jul 18 15:15:49.327106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 145/283] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:48 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:49.332732 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:49.333590 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:49.342343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:49.343161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:49.344138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:49.344713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:49.451514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:49.462665 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:49.467236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:49.474001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:49.474001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-63e55ea3-7a57-411b-8adb-091421bdc5d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.638350 Jul 18 15:15:49.474001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 139/284] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:48 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:49.477155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:49.480500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:49.489160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d00c0000-65f5-4d1f-9825-e7f87e970db7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1210 microversion: 2.1 time: 0.160741 Jul 18 15:15:49.494697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:49.495807 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:49.496895 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:49.497607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:49.498004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 146/285] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:49 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:49.849129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:49.849799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:49.859752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:49.860208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:49.867500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:49.868121 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.012807 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:50.031537 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bf247030-8ce6-4a7e-ade4-1cd5fde391a1 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.556990 Jul 18 15:15:50.033651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 140/286] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:49 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:50.255137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:50.269274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-938dc18f-5330-46f0-8268-fb09ce1e9fa2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.424050 Jul 18 15:15:50.271602 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 147/287] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:49 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:50.346623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:50.347703 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:50.357314 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:50.357761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.358593 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:50.359018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.495377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:50.497094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:50.520099 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:50.520855 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.523971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:50.525483 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.793777 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:50.807640 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f0bbbadf-edd8-4839-9b8c-898ba4c72994 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.465843 Jul 18 15:15:50.811141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 141/288] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:50 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:50.848262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:50.852233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:50.894073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:50.894073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.894073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:50.896760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:50.952291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:50.974505 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:50.981240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:50.983373 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e920e7a2-f731-4426-87a0-ef4ee93bb5a2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.495717 Jul 18 15:15:50.998055 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 148/289] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:50 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:51.052988 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:51.054222 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:51.066281 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:51.066974 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:51.068188 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:51.070314 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:51.372042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:51.386784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9ffa2573-d983-4686-9664-607a022df3e4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.337745 Jul 18 15:15:51.399864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 149/290] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:51 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:51.414349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:51.417031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:51.434092 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:51.435582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:51.438590 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:51.439667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:51.673049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:51.711300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-11082752-6e9a-4314-ae1c-55e08422acaa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1210 microversion: 2.1 time: 0.897181 Jul 18 15:15:51.720774 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 142/291] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:50 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1210 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:51.828623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:51.829437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:51.830064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:51.836802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:51.844607 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9966a140-f889-4723-a4a3-5730e94363f3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.442428 Jul 18 15:15:51.845566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:51.846668 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:51.847294 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:51.849756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 150/292] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:51 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:52.012084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:52.020737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:52.034351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.037434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.038584 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.042572 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.206154 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:52.208306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:52.220583 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ecf5d731-2d84-4d7b-9bd9-9241a529107a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.395688 Jul 18 15:15:52.220825 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:52.221816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 143/293] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:51 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:52.223175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:52.224439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3b135aed-665f-4ef3-87e4-005c62375311 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.216847 Jul 18 15:15:52.225184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 151/294] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:52 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:52.404979 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:52.405504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:52.411844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.412291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.413125 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.413569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.567947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:52.579623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-03fe87af-889e-4c9a-9da1-b594132719dd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.178630 Jul 18 15:15:52.580221 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 144/295] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:52 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:52.747103 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:52.747733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:52.759733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.763432 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.764664 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.765392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.871403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:52.872469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:52.886018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.887921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.894421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:52.894421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:52.963440 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:52.973291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2ea51b7e-2348-4564-9743-9bebfc0e4a17 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1210 microversion: 2.1 time: 0.230689 Jul 18 15:15:53.000397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 152/296] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:52 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:53.247305 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:53.256309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:53.266217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.267083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.268268 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.269121 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.285356 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:53.294760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b785af21-035d-42c9-bda9-926306e347e1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.429055 Jul 18 15:15:53.296240 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 145/297] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:52 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:53.301557 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:53.303902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:53.310969 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.311807 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.312918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.313594 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.523559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:53.532061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7606d376-9716-4b2f-84c3-d772b54f7b56 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1502 microversion: 2.1 time: 0.290972 Jul 18 15:15:53.535077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 153/298] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:53 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1502 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:53.554010 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76425b7e-e869-4d6d-a680-c04902d8eca6"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:53.558746 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:53.565877 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.566655 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.567950 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.583114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.627491 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] HTTP exception thrown: Cannot 'attach_volume' instance 541110c4-7284-457c-8298-e2235b1cb050 while it is in vm_state rescued Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Request method failure captured: Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/os-volume_attachments HTTP/1.1 Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 74 Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XilQOYHXnhdj8LVhm7yZ74HO2Lcn7vbfHWa-RSIfxRpuNTHr6-zMoophvAWGrAJjebPvYyHYWva1LAM5w9F1HEcJaB67vDQDlBjZEG_w9tq_Qi3149rOCGtxWQp4jBQHRz5XSFm1jGrr9iWAPcw-e-hec50dMNiV7D_ksgh51StYiE Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:15:53.630084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0e83fff7c7524da9905cdb86ccdb565a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 648c869550ee437a8e775e997c741e58 Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {"volumeAttachment": {"volumeId": "76425b7e-e869-4d6d-a680-c04902d8eca6"}} Jul 18 15:15:53.633199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Cannot 'attach_volume' instance 541110c4-7284-457c-8298-e2235b1cb050 while it is in vm_state rescued Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'server_id': '541110c4-7284-457c-8298-e2235b1cb050', 'body': {'volumeAttachment': {'volumeId': '76425b7e-e869-4d6d-a680-c04902d8eca6'}}} Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 541110c4-7284-457c-8298-e2235b1cb050 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:15:53.634791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 541110c4-7284-457c-8298-e2235b1cb050 while it is in vm_state rescued Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:15:53.636123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 541110c4-7284-457c-8298-e2235b1cb050 while it is in vm_state rescued Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Returning 409 to user: Cannot 'attach_volume' instance 541110c4-7284-457c-8298-e2235b1cb050 while it is in vm_state rescued {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1e101fa7-2365-4704-8a29-728031df4866 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084153 Jul 18 15:15:53.637760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 154/299] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:15:53 2022] POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 15:15:53.643778 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:53.645561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:53.645730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:53.656279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:53.670989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.670989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.671273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:53.671490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.671589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c0681d34-6810-42a4-8559-2825d6758aee tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.361931 Jul 18 15:15:53.671688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.671780 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 146/300] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:53 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:53.684362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:53.685956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:53.698446 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.700945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.700945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:53.700945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:53.955475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:53.971140 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b38e64fb-c739-4e7f-a745-a78583c303e9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.332599 Jul 18 15:15:53.972775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 155/301] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:53 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:53.998918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:54.002285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:54.011275 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.015779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.015779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.015779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.065337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:54.158636 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:54.175219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-58764af9-e746-4238-92a7-497bfb42579a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1266 microversion: 2.1 time: 0.186922 Jul 18 15:15:54.177159 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 156/302] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:53 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:54.315375 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d209cbdb-7ad5-4d76-8fe4-57cdb1ffb85c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/action" status: 202 len: 0 microversion: 2.1 time: 0.648081 Jul 18 15:15:54.316375 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 147/303] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:15:53 2022] POST /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:15:54.325362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:54.325725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:54.326419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:54.326950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:54.341628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.342631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.342944 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.343370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.344796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.346039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.347308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.348717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.636442 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:54.648390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4bdc1b25-68fb-4970-addc-b71d1b3d8f5c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1510 microversion: 2.1 time: 0.327386 Jul 18 15:15:54.669995 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 148/304] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:54 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:54.687225 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:54.690212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:54.708944 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.709921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.719227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:54.719699 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:54.816133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:54.875559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7c3ed9c8-e520-4733-a3d6-57f44eff8269 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.550997 Jul 18 15:15:54.894718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 157/305] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:54 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:54.997527 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:54.999593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:55.007397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:55.008258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:55.009744 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:55.010437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:55.500421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:55.515450 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:55.517565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:55.522696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9d59f932-d537-429a-b991-aef72749c2a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.845459 Jul 18 15:15:55.536586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 149/306] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:54 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:55.548032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:55.552389 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:55.560995 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:55.568590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:55.574133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:55.574961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:55.765463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:55.783929 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a861236e-3206-4e03-8cd9-cde86031c49e tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1284 microversion: 2.1 time: 0.245438 Jul 18 15:15:55.785102 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 150/307] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:55 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:55.800283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:55.800283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:55.811697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:55.813057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:55.814325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:55.815319 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:56.214566 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:56.233984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-53ab82f0-37ff-4d65-8902-adebaec9b34a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 1.243791 Jul 18 15:15:56.238196 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 158/308] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:54 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:56.246248 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:56.250923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:56.256315 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a9b5a8fe-0ab8-417e-a89c-106e64cce3a1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1510 microversion: 2.1 time: 0.466693 Jul 18 15:15:56.273241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:56.273241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:56.274379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 151/309] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:55 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:56.276819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:56.281755 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:56.284681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:56.285230 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:56.543466 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:56.544329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:56.559324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:56.559324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:56.560057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:56.560622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:56.680927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:56.721299 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=10 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:56.852270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:56.861142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-54c795c3-f84a-4a4c-9eb5-5ffb0718437f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.618525 Jul 18 15:15:56.883314 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 159/310] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:56 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:56.896730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:56.898267 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:56.924943 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:56.925750 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:56.927438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:56.930598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:57.112721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:57.125365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8bb0b7b5-cc85-4a7f-bda4-1ac3882a46ea tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1272 microversion: 2.1 time: 0.237253 Jul 18 15:15:57.126235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 160/311] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:56 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:57.258606 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:57.260157 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:57.272898 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:57.278807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:57.280022 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:57.281089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:57.305928 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:57.336591 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:57.351013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:57.355856 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0b1ba489-c2c9-4d9f-8a64-2bc1fd65263d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1745 microversion: 2.20 time: 0.818290 Jul 18 15:15:57.356624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 152/312] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:56 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1745 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:15:57.375985 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:57.383742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:57.415815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:57.426439 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:57.427918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:57.429355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:57.482502 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=12 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:15:57.898507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:57.910943 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-db351920-45c2-4282-ada1-69fa35709578 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.656317 Jul 18 15:15:57.916845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 161/313] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:57 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:57.922838 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:57.926430 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:57.941497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:57.943519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:57.947298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:57.948084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:58.043135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:58.051922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-09f44ca3-a41d-484e-86cd-2a9231f263f8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1510 microversion: 2.1 time: 0.679085 Jul 18 15:15:58.062624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 153/314] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:57 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1510 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:58.148191 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:58.148866 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:58.173147 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:58.174214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:58.175290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:58.180677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:58.300963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:58.319724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-08a251e5-1972-4c2d-97f8-35f34cbf2b57 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1272 microversion: 2.1 time: 0.178471 Jul 18 15:15:58.322876 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 154/315] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:58 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:15:58.376714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:58.377626 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:58.393078 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:58.395059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:58.408934 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:58.409573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:58.765841 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:58.783301 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:58.788640 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:58.800965 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c8dde82-c94a-4f72-a866-0a199e181fb6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1745 microversion: 2.20 time: 0.429598 Jul 18 15:15:58.811352 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 155/316] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:58 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1745 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:15:58.940637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:58.941712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:58.941883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:58.950939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a6a03217-006a-4aa8-b149-7275de212e3e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 1.032578 Jul 18 15:15:58.951552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 162/317] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:57 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:58.961369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:58.962970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:58.966723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:58.966723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.086902 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:59.087732 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:59.100938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.102149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.110116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.111063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.258722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:59.315280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9a034785-257c-4f54-ac62-6c2752b1cd58 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.380007 Jul 18 15:15:59.327923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 156/318] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:58 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:59.353224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:59.353943 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:59.379687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.379864 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.380945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.382161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.455966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:59.468441 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-51858ee0-e801-406e-a297-c5d20a5879e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1510 microversion: 2.1 time: 0.400894 Jul 18 15:15:59.469775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 163/319] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:59 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:59.728703 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:15:59.748292 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7368cc79-3f0c-430d-850f-fe7b6627e8ad tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.412042 Jul 18 15:15:59.749570 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 157/320] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:59 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:15:59.820910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:59.821637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:59.828920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.829391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.830191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.835624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.896833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-7bf0c1da-897d-4103-8903-ccee350d0204 req-2a0f4f03-4fcf-44f7-81e5-47b8924013cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "name": "network-vif-plugged", "status": "completed", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:15:59.918857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7bf0c1da-897d-4103-8903-ccee350d0204 req-2a0f4f03-4fcf-44f7-81e5-47b8924013cb service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.918857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7bf0c1da-897d-4103-8903-ccee350d0204 req-2a0f4f03-4fcf-44f7-81e5-47b8924013cb service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:15:59.942524 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-7bf0c1da-897d-4103-8903-ccee350d0204 req-2a0f4f03-4fcf-44f7-81e5-47b8924013cb service nova] Creating event network-vif-plugged:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:15:59.957864 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-7bf0c1da-897d-4103-8903-ccee350d0204 req-2a0f4f03-4fcf-44f7-81e5-47b8924013cb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064870 Jul 18 15:15:59.959161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 158/321] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:15:59.984453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:15:59.986603 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:15:59.998847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:15:59.999732 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.001047 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.001933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.254368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:00.266187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2a0e9c3a-718d-40f8-9632-988e0e457afa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.298393 Jul 18 15:16:00.274082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 159/322] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:15:59 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:00.336746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:00.337454 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:00.344839 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.345324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.346988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.347444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.618970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:00.630970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1a441ca0-bade-43e3-bf14-b58cef638e1f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.299666 Jul 18 15:16:00.632280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 160/323] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:00 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:00.650618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:00.650618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:00.658995 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.659717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.660734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.661552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.868560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:00.869184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:00.880200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0aaeb075-3d0f-4421-93f9-5746e115c11d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1516 microversion: 2.1 time: 0.246859 Jul 18 15:16:00.886385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 161/324] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:00 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:00.887594 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:00.892944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:00.895674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9613f4ce-160e-4d03-91ab-a8579d95746a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1745 microversion: 2.20 time: 1.079146 Jul 18 15:16:00.896998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 164/325] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:15:59 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1745 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:00.915613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:00.915613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:00.941387 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.942488 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:00.943617 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:00.947421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:01.153989 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:01.162394 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9ed2e8bb-db4e-420b-b554-2e792af3f4e5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.273557 Jul 18 15:16:01.174564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 162/326] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:00 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:01.285931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:01.287740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:01.299610 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:01.301124 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:01.302840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:01.304354 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:01.636446 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:01.657500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:01.658310 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:01.663948 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-67b207b0-e6ed-46bf-8d1c-09cd6a2cc213 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.383378 Jul 18 15:16:01.681947 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 165/327] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:01 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:01.689833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:01.690311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:01.691134 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:01.691588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:01.918199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:01.918851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:01.931356 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:01.931833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:01.932648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:01.933098 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:02.026468 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:02.036835 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b1ed4d65-4ca0-4b22-b2af-c52d57136130 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.390051 Jul 18 15:16:02.047722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 163/328] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:01 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:02.186733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:02.196411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:02.201358 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:02.207932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:02.208471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:02.209876 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:02.210213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:02.210493 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:02.212419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:02.213886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b0ba5443-dec2-4266-b612-c69016fe1047 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.299761 Jul 18 15:16:02.214458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 166/329] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:01 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:02.349298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-0d92a494-6c5c-4547-980b-bf6c85f01195 req-9d3581f6-f7f8-44c8-a252-690007bf1ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86aef034-57eb-465d-8f49-16627412384b", "tag": "6f994894-d403-4dcd-b7a1-0caafa43f86f"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:02.359531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-0d92a494-6c5c-4547-980b-bf6c85f01195 req-9d3581f6-f7f8-44c8-a252-690007bf1ad0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:02.360585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-0d92a494-6c5c-4547-980b-bf6c85f01195 req-9d3581f6-f7f8-44c8-a252-690007bf1ad0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:02.369826 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:02.373630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-0d92a494-6c5c-4547-980b-bf6c85f01195 req-9d3581f6-f7f8-44c8-a252-690007bf1ad0 service nova] Creating event network-changed:6f994894-d403-4dcd-b7a1-0caafa43f86f for instance 86aef034-57eb-465d-8f49-16627412384b on hv-cinder-83697 Jul 18 15:16:02.378370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-df1a99ad-d70c-4492-a669-ed562273fc89 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.201580 Jul 18 15:16:02.379008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 164/330] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:02 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:02.383170 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-0d92a494-6c5c-4547-980b-bf6c85f01195 req-9d3581f6-f7f8-44c8-a252-690007bf1ad0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035354 Jul 18 15:16:02.383170 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 167/331] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:16:02.687023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:02.687677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:02.701333 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:02.702334 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:02.703488 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:02.704496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:02.898647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0f5106ad-d2e9-4529-a3b1-73a7546b394e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'create', calling method: .version_select at 0x7f48c1744af0>, body: {"keypair": {"name": "tempest-keypair-1337440721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCYiLgN+T4aXpAe6YUc3I2Rcgkjpng22Xk4gNgbIGrQ0F3EOV5iva6N5SIbHkBTxjdIPR1wnzjibpCqHzY4cLlG62BEvPbfc2rzHAkJN/AgYrv8h/v612m+nxVHg5LORw=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:02.943646 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-0f5106ad-d2e9-4529-a3b1-73a7546b394e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:16:02.951597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-0f5106ad-d2e9-4529-a3b1-73a7546b394e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for user 648c869550ee437a8e775e997c741e58 and project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:16:03.042405 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0f5106ad-d2e9-4529-a3b1-73a7546b394e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162000 Jul 18 15:16:03.043570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 168/332] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:16:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:03.058113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:03.059564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:03.067569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:03.068341 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:03.070359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:03.071023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:03.151983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:03.168374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7a25eb15-f9b3-4640-ba70-14f7cbea3c77 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.486326 Jul 18 15:16:03.171290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 165/333] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:02 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:03.240475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:03.241189 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:03.252952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:03.254717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:03.258899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:03.259453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:03.633286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:03.643767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c6637df8-f894-430b-8a4a-73a1d3ce7f97 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.593014 Jul 18 15:16:03.645068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 169/334] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:03 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:03.651243 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:03.652130 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:03.659946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:03.660854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:03.662236 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:03.662956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:03.890212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:03.922113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:03.927639 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:03.929900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f9eb49b2-96ec-4c14-bbfc-33ae25224886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.694615 Jul 18 15:16:03.934148 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 166/335] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:03 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:04.151495 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:04.164336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-92792aad-d164-4bd1-9db9-773143797d3a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.517498 Jul 18 15:16:04.185433 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 170/336] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:03 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:04.200511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:04.201740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:04.216486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:04.217402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:04.219064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:04.219690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:04.668168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:04.668168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:04.677396 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:04.684840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:04.686042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:04.686699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:04.963944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:04.979137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dae75c3e-9b83-4560-8311-be04bc1fd46d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.320169 Jul 18 15:16:04.998820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 171/337] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:04 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:05.019495 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:05.020178 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:05.039957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:05.040424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:05.045087 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:05.045519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:05.170624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:05.205791 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0ea293e3-ef92-4fd0-94a3-ba3160da981f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 1.018964 Jul 18 15:16:05.208235 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 167/338] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:04 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:05.229548 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:05.379802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:05.379802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:05.379802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:05.379802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:05.381932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:05.425651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:05.439552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:05.444440 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:05.451167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3abc685f-3e3b-46e9-9f17-cc67fa26e999 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.450274 Jul 18 15:16:05.452578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 172/339] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:04 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:05.742609 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:05.760788 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4b9ef11f-9089-4388-b7a6-9a8c257dd914 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.550970 Jul 18 15:16:05.774792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 168/340] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:05 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:06.002461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:06.003116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:06.013838 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.014303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.015149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.015605 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.206143 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:06.228095 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:06.229556 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:06.242585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.242585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.242585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.242585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.243001 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c7c11f57-a767-457d-a07b-f627db491e3f tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.241570 Jul 18 15:16:06.243001 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 173/341] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:05 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:06.245135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:06.470999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:06.472419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:06.480291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.481224 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.482215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.482788 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.571705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:06.582151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f11b021c-f56b-41d4-ab83-8bfe72e8e748 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1719 microversion: 2.1 time: 0.360188 Jul 18 15:16:06.587468 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 169/342] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:06 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1719 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:06.782712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:06.783661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:06.805934 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.813762 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:06.815050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:06.816244 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:07.059721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:07.065410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:07.119096 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:07.122988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:07.125243 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:07.135054 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9b58e96-82aa-43d3-a9cb-33874c99f6b2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.358895 Jul 18 15:16:07.137224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 170/343] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:06 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:07.157583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d9c324a0-7151-4aa8-94e3-d17f5955f85b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.685946 Jul 18 15:16:07.157583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 174/344] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:06 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:07.160783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-fffab4bf-00d4-4d84-8886-673ba8a9137b req-ec67dddd-7775-4547-9729-f499b2e06ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "name": "network-vif-plugged", "status": "completed", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:07.191860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-fffab4bf-00d4-4d84-8886-673ba8a9137b req-ec67dddd-7775-4547-9729-f499b2e06ae8 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:07.191860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-fffab4bf-00d4-4d84-8886-673ba8a9137b req-ec67dddd-7775-4547-9729-f499b2e06ae8 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:07.222439 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-fffab4bf-00d4-4d84-8886-673ba8a9137b req-ec67dddd-7775-4547-9729-f499b2e06ae8 service nova] Creating event network-vif-plugged:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:16:07.228641 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-fffab4bf-00d4-4d84-8886-673ba8a9137b req-ec67dddd-7775-4547-9729-f499b2e06ae8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072069 Jul 18 15:16:07.230447 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 171/345] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:07.257955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:07.258964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:07.285597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:07.286066 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:07.286914 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:07.287362 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:07.613634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:07.614357 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:07.634851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:07.635304 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:07.636106 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:07.636542 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:07.890108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:07.904417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2c59bd92-e89f-4f73-94b9-74aec15a4638 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.650587 Jul 18 15:16:07.905190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 175/346] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:07 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:07.914396 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:07.928613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-36c4328a-a465-4fc2-b24e-39d3cd7caffe tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1696 microversion: 2.1 time: 0.316662 Jul 18 15:16:07.929375 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 172/347] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:07 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1696 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:07.949520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3d165157-24c2-41e8-b5fc-73c61a1cbe8e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:07.961411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d165157-24c2-41e8-b5fc-73c61a1cbe8e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:07.963900 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d165157-24c2-41e8-b5fc-73c61a1cbe8e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:08.155347 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3d165157-24c2-41e8-b5fc-73c61a1cbe8e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Going to try to start instance {{(pid=118339) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 15:16:08.167762 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:08.168837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:08.188935 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:08.191565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:08.192786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:08.198947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:08.401667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3d165157-24c2-41e8-b5fc-73c61a1cbe8e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action" status: 202 len: 0 microversion: 2.1 time: 0.457587 Jul 18 15:16:08.403303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 176/348] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:16:07 2022] POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:16:08.421991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:08.423584 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:08.436049 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:08.436845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:08.437981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:08.438761 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:08.543848 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:08.562946 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-406d3eed-c4c1-420a-b9dc-15745a0ebfe5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.400887 Jul 18 15:16:08.564039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 173/349] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:08 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:08.581905 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:08.589865 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:08.622244 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:08.624053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:08.628334 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:08.633559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:09.228892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:09.239425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:09.244572 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:09.250971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-96ef7b0d-dd2e-42c3-a188-631ce6dd6512 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.845781 Jul 18 15:16:09.266374 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 177/350] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:08 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:09.278272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:09.283532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:09.301324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:09.308949 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:09.315758 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:09.323226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6ac586e2-501a-4d36-b316-aaa1c8211084 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1705 microversion: 2.1 time: 0.757826 Jul 18 15:16:09.323827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 174/351] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:08 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1705 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:09.324934 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:09.325551 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:09.326000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:09.596372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:09.597750 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:09.607795 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:09.608775 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:09.609824 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:09.610579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:09.856043 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:09.872956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4c3ce9df-fa81-4348-886d-46c84bad53b0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1359 microversion: 2.1 time: 0.601290 Jul 18 15:16:09.873586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 178/352] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:09 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1359 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:09.916879 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:09.926695 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-334ac656-e7b2-4cdc-9e98-00bf7401c0fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.336329 Jul 18 15:16:09.927624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 175/353] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:09 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:10.288996 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:10.289812 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:10.314498 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:10.317019 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:10.324002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:10.325065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:10.344107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:10.346339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:10.360039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:10.366415 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:10.368281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:10.371382 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:10.372069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:10.873456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:10.894829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7b090790-1ac2-4514-b582-d7cd1aac8fc7 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1705 microversion: 2.1 time: 0.555272 Jul 18 15:16:10.912269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 176/354] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:10 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1705 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:10.938771 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:10.941579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:10.965444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:10.965872 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:10.966701 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:10.975414 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:11.369964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:11.389616 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b4511bfc-a205-4c64-b3fa-5b2ac558c7b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1550 microversion: 2.1 time: 0.473068 Jul 18 15:16:11.394166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 177/355] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:10 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1550 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:11.400351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:11.401355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:11.423284 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:11.429060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:11.429060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:11.429060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:11.534254 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:11.552951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:11.559742 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:11.561826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-99ef46a3-23c8-426d-b666-b5a88f9c7f59 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 1.295679 Jul 18 15:16:11.562567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 179/356] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:10 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:11.567868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:11.569867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:11.579997 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:11.580842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:11.581908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:11.582765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:11.849635 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:11.862658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cd09dfba-b177-4a10-9c8d-fa3c8ab1b537 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.470234 Jul 18 15:16:11.872958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 178/357] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:11 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:11.917037 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:11.917691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:11.942316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:11.946945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:11.949437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:11.952418 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:12.420531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:12.439186 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5609b33d-4174-4382-91f3-9004800ec47d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1705 microversion: 2.1 time: 0.526759 Jul 18 15:16:12.459181 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 179/358] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:11 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1705 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:12.537784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:12.550643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-eb663b00-a0a5-4b58-964f-3b30da66bb5c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1550 microversion: 2.1 time: 0.985804 Jul 18 15:16:12.550643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 180/359] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:11 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1550 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:12.569322 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:12.574211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:12.579234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Searching by: {'deleted': False, 'project_id': 'eb8e493ee52b4c2686d5010eed312191'} {{(pid=118340) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 15:16:12.581006 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:12.581712 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:12.594137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:12.595006 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:12.596019 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:12.596830 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:12.599721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:12.601517 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:12.605337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:12.606634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:12.793266 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.multi_cell_list [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 15:16:12.964628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=4 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:13.108553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f98a5c4-be69-4f94-85a7-ab1ca24cc160 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.543473 Jul 18 15:16:13.109685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 180/360] 10.222.0.83 () {58 vars in 1124 bytes} [Mon Jul 18 15:16:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:13.122048 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:13.123764 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:13.124536 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:13.132127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:13.138079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:13.152761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:13.153384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:13.153670 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-98495b19-66e5-4717-ab5a-eb6473497cbd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.569745 Jul 18 15:16:13.155959 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:13.156479 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:13.167013 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 181/361] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:12 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:13.171755 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:13.176661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:13.190025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:13.190931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:13.192244 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:13.193588 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:13.652228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:13.665465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f640dca-5739-4788-b492-eb093409b69a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.554465 Jul 18 15:16:13.669022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 181/362] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:13 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:13.677453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1117321732", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80d53c3d-afce-4553-ba02-d131a7abe419"}], "security_groups": [{"name": "tempest-securitygroup--1220433011"}], "key_name": "tempest-keypair-1337440721", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:13.920014 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:13.935923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b5b1ab3a-6193-4a47-af3e-6c1e84796b74 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1550 microversion: 2.1 time: 0.768601 Jul 18 15:16:13.936842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 182/363] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:13 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1550 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:13.953659 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-6d81a598-6cc1-4743-9daf-a2d6628aea34 req-6896d19e-7499-4f66-8de6-aa363607e9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86aef034-57eb-465d-8f49-16627412384b", "name": "network-vif-plugged", "status": "completed", "tag": "6f994894-d403-4dcd-b7a1-0caafa43f86f"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:13.967708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] validate_networks() for [('80d53c3d-afce-4553-ba02-d131a7abe419', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:16:14.013697 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-6d81a598-6cc1-4743-9daf-a2d6628aea34 req-6896d19e-7499-4f66-8de6-aa363607e9c5 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:14.014274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-6d81a598-6cc1-4743-9daf-a2d6628aea34 req-6896d19e-7499-4f66-8de6-aa363607e9c5 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:14.066523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-6d81a598-6cc1-4743-9daf-a2d6628aea34 req-6896d19e-7499-4f66-8de6-aa363607e9c5 service nova] Creating event network-vif-plugged:6f994894-d403-4dcd-b7a1-0caafa43f86f for instance 86aef034-57eb-465d-8f49-16627412384b on hv-cinder-83697 Jul 18 15:16:14.080945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-6d81a598-6cc1-4743-9daf-a2d6628aea34 req-6896d19e-7499-4f66-8de6-aa363607e9c5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138764 Jul 18 15:16:14.085686 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 183/364] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:14.106461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:14.113349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:14.140900 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:14.142153 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:14.144647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:14.145107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:14.933698 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:14.949069 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-660bf7ee-9bc6-4bf6-8c0e-10ce7e2f226c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1709 microversion: 2.1 time: 0.859823 Jul 18 15:16:14.950116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 184/365] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:14 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1709 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:14.968665 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:14.970445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:14.995728 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:15.000519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:15.001644 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:15.002285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:15.045459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:16:15.045983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:16:15.046379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:16:15.046826 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:16:15.048612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:16:15.074734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:15.075197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:15.076012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:15.076448 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:15.116741 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:16:15.124198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Getting quotas for user 648c869550ee437a8e775e997c741e58 and project 0e83fff7c7524da9905cdb86ccdb565a. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:16:15.143625 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:16:15.146839 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:16:15.273088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d7e1d605-1709-423b-a1c5-df59a1fdd48b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.601054 Jul 18 15:16:15.274607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 182/366] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:16:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:16:15.282326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:15.283627 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:15.299719 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:15.300483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:15.303618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:15.304932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:15.433482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:15.448733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:15.450489 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:15.457452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d7841a14-19bc-4ca2-8dc2-c73146db831f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.493736 Jul 18 15:16:15.460509 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 185/367] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:14 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:15.467403 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f1e41511-d43b-4278-bb3c-28807e6307ee tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:15.468369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f1e41511-d43b-4278-bb3c-28807e6307ee tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:15.653961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:15.663463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6ecc4851-0b66-4669-bbc7-3e4f0f682aa2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.386942 Jul 18 15:16:15.665816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 183/368] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:15 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:15.670158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f1e41511-d43b-4278-bb3c-28807e6307ee tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:15.679975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f1e41511-d43b-4278-bb3c-28807e6307ee tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1246 microversion: 2.1 time: 0.216662 Jul 18 15:16:15.681998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 186/369] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:15 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1246 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:16.502461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:16.508267 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:16.533035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:16.541079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:16.541079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:16.541079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:16.690818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:16.695807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:16.708343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:16.711636 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:16.716476 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:16.717687 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:16.839560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:16.854519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:16.856328 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:16.861937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9d4a50f0-5df0-43d4-8652-ea54031c01af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.368197 Jul 18 15:16:16.867637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 184/370] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:16 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:16.876001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ffbd8766-416f-4000-98dd-aac62f1704ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:16.876782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ffbd8766-416f-4000-98dd-aac62f1704ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:17.015039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ffbd8766-416f-4000-98dd-aac62f1704ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:17.035562 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ffbd8766-416f-4000-98dd-aac62f1704ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1246 microversion: 2.1 time: 0.165822 Jul 18 15:16:17.037841 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 185/371] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:16 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1246 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:17.082576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "265b8e35-7ae0-45c3-b3d8-6a5e6a320653"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:17.086330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:17.094222 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:17.103015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a93929d7-36c0-4205-9529-ce7fe56a1b71 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1314 microversion: 2.1 time: 0.419084 Jul 18 15:16:17.104584 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 187/372] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:16 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:17.106801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:17.107276 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:17.108099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:17.108549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:17.894274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:17.895690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:17.903206 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:17.904035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:17.905075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:17.905722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:18.092135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:18.239811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:18.252313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:18.254945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:18.255330 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f953a48d-1c8e-4f80-be45-526224c375d2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.365018 Jul 18 15:16:18.263683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 188/373] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:17 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:18.275201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:18.278067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:18.285746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-482ad1c4-ae09-4c7e-8ebc-ca3f013dd1e2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.217014 Jul 18 15:16:18.290901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 186/374] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:16:17 2022] POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 194 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:16:18.311304 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:18.312684 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:18.314456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:18.315185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:18.316116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:18.316951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:18.338434 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:18.338960 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:18.340026 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:18.340464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:18.650398 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:18.663535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e0c6295f-bb85-486d-9470-c1c9c20c09c3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1298 microversion: 2.1 time: 0.393767 Jul 18 15:16:18.670635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 189/375] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:18 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1298 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:18.832868 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:18.846748 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-906dea33-a918-407c-a350-7cbb6707ca32 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1498 microversion: 2.1 time: 0.551519 Jul 18 15:16:18.847979 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 187/376] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:18 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1498 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:19.283668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:19.284310 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:19.294035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:19.294506 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:19.295348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:19.302893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:19.691318 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:19.701595 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:19.703593 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:19.704315 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:19.705344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:19.706005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:19.849176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:19.872040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef470f08-4f56-4360-afe9-d748fab9b226 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1316 microversion: 2.1 time: 0.186070 Jul 18 15:16:19.885717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 188/377] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:19 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:19.910679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:19.928277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:19.931756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:19.944570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9a97279e-0025-4e25-afac-6c027b3fba0d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.662102 Jul 18 15:16:19.945634 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 190/378] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:19 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:20.520269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:20.521232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:20.533210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:20.538215 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:20.538425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:20.539471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:20.637869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:16:20.893171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:20.894640 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:20.939111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:20.947557 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:20.948624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:20.949097 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:21.094074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-106dde6f-8b56-4b0b-a504-5e8e2056c60a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "DELETE /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 204 len: 0 microversion: 2.1 time: 0.577600 Jul 18 15:16:21.095226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 189/379] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:16:20 2022] DELETE /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:16:21.115057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:21.118168 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:21.154288 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:21.158312 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:21.159473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:21.161208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:21.371685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:21.383290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7a00f7af-e7c7-47e8-8e2c-571c98559f90 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.495070 Jul 18 15:16:21.390901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 191/380] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:20 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:21.399377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:21.400278 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:21.418596 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:21.418596 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:21.423494 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:21.423494 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:21.428957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:21.773107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:21.782912 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e59d71b8-3490-4054-864e-67c436067887 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1504 microversion: 2.1 time: 0.390213 Jul 18 15:16:21.784042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 192/381] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:21 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:22.136625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5cc52720-7487-48e6-8b4d-3aab3b4d1d81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Action: 'create', calling method: .version_select at 0x7f48c16f3ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-483268862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5/7GXf9r3ZTQ+eXywqutnZT/Djw9ddZnuhpHYlfb7m9//QulBoDnLxHS4nkfnpx22g9ar4eU8nsP8FHs+RHeS/9mUvl4xnGh7vlmw6qqn6r8Sv9zZAei4YaXBvDBpAPA=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:22.167049 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-5cc52720-7487-48e6-8b4d-3aab3b4d1d81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Getting quotas for project 5c88f3beb8bf468f9a30311b203b13cf. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:16:22.175707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-5cc52720-7487-48e6-8b4d-3aab3b4d1d81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Getting quotas for user dcfdd71f9b93426bb6b149d2aeb2088e and project 5c88f3beb8bf468f9a30311b203b13cf. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:16:22.221572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:22.233825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:22.236133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:22.243558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7182dd15-2cf3-447b-a7fb-91f92017a6d6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 1.146764 Jul 18 15:16:22.244605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 190/382] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:21 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:22.403948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:22.404760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:22.431825 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5cc52720-7487-48e6-8b4d-3aab3b4d1d81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.645795 Jul 18 15:16:22.438350 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 193/383] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:16:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:22.440914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:22.441613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:22.442661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:22.443281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:22.813355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:22.813988 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:22.832495 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:22.833932 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:22.839913 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:22.840756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:22.855937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:22.885415 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fb15f6eb-c4cd-4d9f-99ef-e4a8fdc0d1e2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.485242 Jul 18 15:16:22.886290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 191/384] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:22 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:22.910711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-5297fb6d-ac1c-4ac2-af22-4f39196fca71 req-5afbb5ed-4370-4188-bd7a-454bb332e6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea90bbda-13c2-40f9-bd93-daa1e79f27dd", "tag": "e9e943a0-f833-4d66-8068-fd9533d671de"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:22.968355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5297fb6d-ac1c-4ac2-af22-4f39196fca71 req-5afbb5ed-4370-4188-bd7a-454bb332e6bf service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:22.969529 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5297fb6d-ac1c-4ac2-af22-4f39196fca71 req-5afbb5ed-4370-4188-bd7a-454bb332e6bf service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:22.996504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-5297fb6d-ac1c-4ac2-af22-4f39196fca71 req-5afbb5ed-4370-4188-bd7a-454bb332e6bf service nova] Creating event network-changed:e9e943a0-f833-4d66-8068-fd9533d671de for instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd on hv-cinder-83697 Jul 18 15:16:22.996504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-5297fb6d-ac1c-4ac2-af22-4f39196fca71 req-5afbb5ed-4370-4188-bd7a-454bb332e6bf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107026 Jul 18 15:16:22.997240 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 192/385] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:23.268621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:23.271698 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:23.289831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:23.289831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:23.291263 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:23.292706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:23.340415 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:23.363560 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ee8313d2-a804-4942-a809-99a21bb272f2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1504 microversion: 2.1 time: 0.555449 Jul 18 15:16:23.369667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 194/386] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:22 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1504 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:23.729435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:23.747595 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:23.755870 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:23.755870 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e06e1ca0-bbcb-4472-abf2-50aac8814b1c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.493474 Jul 18 15:16:23.763299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 193/387] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:23 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:23.904255 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:23.904998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:23.920406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:23.921207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:23.926713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:23.927469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:24.266151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:24.278135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-af6a642a-a23f-4a9d-b332-26c9ca340f21 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.378140 Jul 18 15:16:24.280403 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 195/388] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:23 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:24.388265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:24.389046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:24.401150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:24.407228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:24.407228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:24.407228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:24.700723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:24.715878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e34f83e3-b11c-413d-b7ad-dbd66c372ca4 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1504 microversion: 2.1 time: 0.332354 Jul 18 15:16:24.716799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 194/389] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:24 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:24.773625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:24.776023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:24.782475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:24.784614 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:24.785574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:24.786038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:24.955560 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:24.964688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:24.966473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:24.967833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6ed919fd-0a80-40f9-939b-c19c926799fa tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.198882 Jul 18 15:16:24.970493 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 196/390] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:24 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:25.301208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:25.301208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:25.303109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:25.332886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:25.340843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:25.340843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:25.340843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:25.468152 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-c333d4af-a604-4ede-9b7a-3d0591545072 req-3d89881d-16f5-4a86-b712-8a1c8df73650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86aef034-57eb-465d-8f49-16627412384b", "name": "network-vif-deleted", "tag": "6f994894-d403-4dcd-b7a1-0caafa43f86f"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:25.490423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-c333d4af-a604-4ede-9b7a-3d0591545072 req-3d89881d-16f5-4a86-b712-8a1c8df73650 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:25.496241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-c333d4af-a604-4ede-9b7a-3d0591545072 req-3d89881d-16f5-4a86-b712-8a1c8df73650 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:25.530107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-c333d4af-a604-4ede-9b7a-3d0591545072 req-3d89881d-16f5-4a86-b712-8a1c8df73650 service nova] Creating event network-vif-deleted:6f994894-d403-4dcd-b7a1-0caafa43f86f for instance 86aef034-57eb-465d-8f49-16627412384b on hv-cinder-83697 Jul 18 15:16:25.551799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-c333d4af-a604-4ede-9b7a-3d0591545072 req-3d89881d-16f5-4a86-b712-8a1c8df73650 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088493 Jul 18 15:16:25.578660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 197/391] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:16:25.767172 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:25.768990 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:25.779887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:25.781725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:25.782812 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:25.783439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:25.888496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:25.900157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d78ff594-3ac7-4f88-9e6e-1c336df83bab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.603977 Jul 18 15:16:25.912424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 195/392] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:25 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:25.988976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:25.989635 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:26.006435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:26.007155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:26.007880 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:26.008334 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:26.019241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:26.029050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c83824e9-c13a-42e1-8444-a8f070721298 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1462 microversion: 2.1 time: 0.286820 Jul 18 15:16:26.041976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 198/393] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:25 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1462 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:26.512374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:26.538145 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:26.541553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:26.542908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-14b07503-2aaa-4302-a37c-7210bf10fa52 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.557907 Jul 18 15:16:26.549295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 196/394] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:25 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:26.947279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:26.947279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:26.947279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:26.947279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:26.949253 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:26.949253 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:27.049475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:27.050111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:27.052209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=8 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:27.062714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:27.063670 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:27.064688 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:27.065344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:27.114831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:27.115491 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:27.116779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lazy-loading 'fault' on Instance uuid 86aef034-57eb-465d-8f49-16627412384b {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:16:27.233580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:27.247743 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:27.255868 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab43b980-c4f2-4d17-8fee-5fb363f07825 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1304 microversion: 2.1 time: 0.211407 Jul 18 15:16:27.257828 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 197/395] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:27 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1304 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:27.266650 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0286fb91-3ec3-4e99-942e-7bb1a52de9da tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.351420 Jul 18 15:16:27.267711 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 199/396] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:26 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:27.562204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:27.563327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:27.582439 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:27.584442 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:27.585706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:27.591447 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:27.878017 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:27.887825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:27.890428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:27.891756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-665be5d9-55d7-4c04-b5af-19ed50761dd5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1740 microversion: 2.20 time: 0.333934 Jul 18 15:16:27.892351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 198/397] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:27 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1740 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:28.091606 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:28.092250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:28.122781 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.123575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.124659 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.125348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.286799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:28.287429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:28.297809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.297809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.297809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.298105 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.335161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.335822 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.336457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lazy-loading 'fault' on Instance uuid 86aef034-57eb-465d-8f49-16627412384b {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:16:28.336609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:28.349405 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-401ec2e4-7fc2-47ab-8c56-7b621663e2bf tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1596 microversion: 2.1 time: 0.265607 Jul 18 15:16:28.350026 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 200/398] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:28 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1596 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:28.357672 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:28.358775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:28.392004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.392004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.392004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.392653 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.461363 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:28.472602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc970283-0b30-4530-91d5-623caaabd765 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 200 len: 1304 microversion: 2.1 time: 0.189805 Jul 18 15:16:28.498341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 199/399] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:28 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:28.760626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:28.772559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4f31dd09-6ece-4f21-9fad-241839285ee8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.419509 Jul 18 15:16:28.774072 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 201/400] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:28 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:28.911125 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:28.911844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:28.919685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.920133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:28.920922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:28.921357 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:29.379522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:29.401245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:29.405424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:29.407062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b178b53d-f27f-4cb7-9c53-3ef764f5428f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1722 microversion: 2.20 time: 0.500308 Jul 18 15:16:29.407658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 200/401] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:28 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1722 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:29.489818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:29.492623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: 86aef034-57eb-465d-8f49-16627412384b] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:29.500287 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:29.501120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:29.502180 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:29.502892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:29.521384 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] HTTP exception thrown: Instance 86aef034-57eb-465d-8f49-16627412384b could not be found. Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Request method failure captured: Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b HTTP/1.1 Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XkdSasEjLCoTg1yOGxGRcOZijVCoP-PBgK79sMucMNhtVx5RRrMNn1P1uyxLW9VRfg74u8JfltPAODdIHmhZ9qIHBVmrQmrNs7HiAqsLUJv_PukapHgBkA2NNt8anRpuL5uBXT2BeYYUPGWye4Ci5Y-16NvERGiiCYYHnVmSNbInRs Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 43a5c5beef1a42f0ac47a1f540e55c21 Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesActionsTest-1092429143 Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:16:29.523427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/43a5c5beef1a42f0ac47a1f540e55c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/43a5c5beef1a42f0ac47a1f540e55c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_43a5c5beef1a42f0ac47a1f540e55c21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/43a5c5beef1a42f0ac47a1f540e55c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesActionsTest-1092429143 Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 43a5c5beef1a42f0ac47a1f540e55c21 Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesActionsTest-1092429143 Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesActionsTest-1092429143-project Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: faa3eace09844298a4cf0373ddc74de1 Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesActionsTest-1092429143-project Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 86aef034-57eb-465d-8f49-16627412384b could not be found. Jul 18 15:16:29.524952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '86aef034-57eb-465d-8f49-16627412384b'} Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86aef034-57eb-465d-8f49-16627412384b could not be found. Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:16:29.525753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86aef034-57eb-465d-8f49-16627412384b could not be found. Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86aef034-57eb-465d-8f49-16627412384b could not be found. Jul 18 15:16:29.527719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:16:29.528919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Returning 404 to user: Instance 86aef034-57eb-465d-8f49-16627412384b could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:16:29.528919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-201d195e-912a-4cfa-aeb7-d98f3b845123 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b" status: 404 len: 111 microversion: 2.1 time: 0.039411 Jul 18 15:16:29.528919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 202/402] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:29 2022] GET /compute/v2.1/servers/86aef034-57eb-465d-8f49-16627412384b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:16:29.680419 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-933540397", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "networks": [{"uuid": "4743e396-953c-45ec-b3dc-6d088fb921fa"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:29.761501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] validate_networks() for [('4743e396-953c-45ec-b3dc-6d088fb921fa', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:16:29.792291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:29.792918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:29.807114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:29.808007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:29.809201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:29.810440 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:30.248861 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:30.258012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2ab634bf-fdf4-4603-919f-6cb64fe94754 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.471128 Jul 18 15:16:30.259397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 203/403] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:29 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:30.418699 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:16:30.419276 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:16:30.419618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:16:30.420046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:16:30.420660 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:16:30.433811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:30.434062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:30.434311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:30.435115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:30.435596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:30.436301 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:30.445878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:30.446659 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:30.447601 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:30.448554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:30.462917 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Getting quotas for project 43a5c5beef1a42f0ac47a1f540e55c21. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:16:30.469661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Getting quotas for user faa3eace09844298a4cf0373ddc74de1 and project 43a5c5beef1a42f0ac47a1f540e55c21. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:16:30.488291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:16:30.492320 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:16:30.689265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3f7961de-466c-4a1f-9006-9ce31a4dcdf2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016095 Jul 18 15:16:30.691823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 201/404] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:16:30.700161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-ac725696-0a5f-449d-ab2b-d7d96c262bdb req-23ca11fb-b108-4921-b986-ff153dd1c1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea90bbda-13c2-40f9-bd93-daa1e79f27dd", "name": "network-vif-plugged", "status": "completed", "tag": "e9e943a0-f833-4d66-8068-fd9533d671de"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:30.720869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-ac725696-0a5f-449d-ab2b-d7d96c262bdb req-23ca11fb-b108-4921-b986-ff153dd1c1a0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:30.721810 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-ac725696-0a5f-449d-ab2b-d7d96c262bdb req-23ca11fb-b108-4921-b986-ff153dd1c1a0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:30.731040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:30.742783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-ac725696-0a5f-449d-ab2b-d7d96c262bdb req-23ca11fb-b108-4921-b986-ff153dd1c1a0 service nova] Creating event network-vif-plugged:e9e943a0-f833-4d66-8068-fd9533d671de for instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd on hv-cinder-83697 Jul 18 15:16:30.749254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-ac725696-0a5f-449d-ab2b-d7d96c262bdb req-23ca11fb-b108-4921-b986-ff153dd1c1a0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055725 Jul 18 15:16:30.750275 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 202/405] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:30.760956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d34b407-8510-4c71-b61e-7d4aa23f5fce tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:30.762172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d34b407-8510-4c71-b61e-7d4aa23f5fce tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:30.830704 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d34b407-8510-4c71-b61e-7d4aa23f5fce tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:30.840418 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d34b407-8510-4c71-b61e-7d4aa23f5fce tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1213 microversion: 2.1 time: 0.088643 Jul 18 15:16:30.841040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 203/406] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:30 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:31.026427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:31.035648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:31.037537 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:31.039693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0e36de21-af3b-423a-a70c-f56c844c0c68 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1722 microversion: 2.20 time: 0.614860 Jul 18 15:16:31.040389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 204/407] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:30 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1722 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:31.290261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:31.291642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:31.312319 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:31.329322 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:31.330323 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:31.355333 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:31.355333 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:31.536290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:31.546610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a78d1ec6-b301-4dcc-b89f-00144d7870d9 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.273612 Jul 18 15:16:31.547214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 204/408] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:31 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:31.857962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f33e37ee-f245-4ed4-834e-8ff3e5e732ab tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:31.858709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f33e37ee-f245-4ed4-834e-8ff3e5e732ab tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:31.945559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f33e37ee-f245-4ed4-834e-8ff3e5e732ab tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:31.956795 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f33e37ee-f245-4ed4-834e-8ff3e5e732ab tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1213 microversion: 2.1 time: 0.102735 Jul 18 15:16:31.957395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 205/409] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:31 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:32.066285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:32.069399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:32.074428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.074919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.075728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.076179 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.247472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:32.259304 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:32.262303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:32.263974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1fd23bdb-5c10-4a40-890f-fa61fddf47f7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1725 microversion: 2.20 time: 0.207005 Jul 18 15:16:32.267081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 205/410] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:32 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:32.285101 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24a592d5-f73d-4f7a-9e46-12da72b5dc97"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:32.287035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:32.301678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.302141 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.302984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.304066 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.579591 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:32.582442 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:32.588796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.589974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.591087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.591988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.791940 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:32.803808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f5b7146f-6cd5-463f-9cb9-67002ff04bdd tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.237553 Jul 18 15:16:32.816221 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 206/411] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:32 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:32.844280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-c3f2a67f-9976-456b-b46f-2682d9f5e45a req-2ed5263f-63f0-4cfa-8233-bc94e6fc90f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "name": "network-vif-unplugged", "status": "completed", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:32.856624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-c3f2a67f-9976-456b-b46f-2682d9f5e45a req-2ed5263f-63f0-4cfa-8233-bc94e6fc90f7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.858047 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-c3f2a67f-9976-456b-b46f-2682d9f5e45a req-2ed5263f-63f0-4cfa-8233-bc94e6fc90f7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:32.876632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-c3f2a67f-9976-456b-b46f-2682d9f5e45a req-2ed5263f-63f0-4cfa-8233-bc94e6fc90f7 service nova] Creating event network-vif-unplugged:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:16:32.895393 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-c3f2a67f-9976-456b-b46f-2682d9f5e45a req-2ed5263f-63f0-4cfa-8233-bc94e6fc90f7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048330 Jul 18 15:16:32.895393 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 207/412] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:32.947188 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-b28fcffc-b132-40ab-afa8-cbc77ca0f242 req-f792abcc-978b-4e0a-b8ba-a5e3e159bd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:32.990575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b28fcffc-b132-40ab-afa8-cbc77ca0f242 req-f792abcc-978b-4e0a-b8ba-a5e3e159bd82 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:32.992056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b28fcffc-b132-40ab-afa8-cbc77ca0f242 req-f792abcc-978b-4e0a-b8ba-a5e3e159bd82 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:33.030199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-b28fcffc-b132-40ab-afa8-cbc77ca0f242 req-f792abcc-978b-4e0a-b8ba-a5e3e159bd82 service nova] Creating event network-changed:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:16:33.035854 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-b28fcffc-b132-40ab-afa8-cbc77ca0f242 req-f792abcc-978b-4e0a-b8ba-a5e3e159bd82 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094359 Jul 18 15:16:33.040424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 208/413] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:16:33.046493 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:33.047166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:33.057883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:33.058828 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:33.060088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:33.060943 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:33.278839 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:33.293097 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7e98c560-af5c-4b01-8270-898e3042c697 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1209 microversion: 2.1 time: 0.251017 Jul 18 15:16:33.296120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 209/414] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:33 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:33.825687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:33.826961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:33.837514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:33.841372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:33.842636 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:33.843106 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:34.129468 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-25ef3957-c8e5-4aa1-b4c5-752e9f7a1e07 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.848683 Jul 18 15:16:34.132979 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 206/415] 10.222.0.83 () {62 vars in 1363 bytes} [Mon Jul 18 15:16:32 2022] POST /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments => generated 188 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:16:34.260129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:34.279470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c2f02c29-3538-460f-9066-042690e655b3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1372 microversion: 2.1 time: 0.457537 Jul 18 15:16:34.283031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 210/416] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:33 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1372 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:34.344837 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:34.345891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:34.391169 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:34.391999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:34.393808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:34.395695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:34.450348 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:34.451662 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:34.466972 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:34.468466 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:34.469730 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:34.470975 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:34.593930 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:34.613138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2853eb5d-ce61-4e82-a26f-1c800e445411 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1265 microversion: 2.1 time: 0.286001 Jul 18 15:16:34.614066 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 207/417] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:34 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:34.844428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-21cef5f5-a615-4fab-9a21-ba3634f315fc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/action" status: 202 len: 0 microversion: 2.20 time: 0.398576 Jul 18 15:16:34.860475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 211/418] 10.222.0.83 () {62 vars in 1318 bytes} [Mon Jul 18 15:16:34 2022] POST /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:16:34.869680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:34.870680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:34.880850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:34.889797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:34.889797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:34.889797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.254150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:35.274486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:35.277142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:35.278690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-701e082d-9ac3-4733-b776-873a7fe722e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.413777 Jul 18 15:16:35.279713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 208/419] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:34 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:35.308425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:35.311112 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:35.323519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:35.324331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.325618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:35.329267 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.565338 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:35.576568 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f0b60d8f-0d04-41a9-a1b4-679761a93c1b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1565 microversion: 2.1 time: 0.274543 Jul 18 15:16:35.577429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 212/420] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:35 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1565 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:35.600022 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:35.601126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:35.609199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:35.609719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.610740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:35.611390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.633776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:35.634933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:35.639093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:35.642899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:35.643358 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.644284 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:35.644730 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:35.739202 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:35.756313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-17425dee-fa24-4587-8891-9467d27a9ac3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1271 microversion: 2.1 time: 0.127672 Jul 18 15:16:35.758466 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 213/421] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:35 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:35.774999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-299603bd-6d40-4ede-8126-c2e41332b3c2 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179924 Jul 18 15:16:35.775624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 209/422] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:16:35 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:36.312948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:36.315556 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:36.335608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:36.336528 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:36.337591 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:36.338259 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:36.723909 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:36.742809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:36.746234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:36.766575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-68102fcc-bd3d-4068-a421-2f85c9eac0e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.445941 Jul 18 15:16:36.766575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 214/423] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:36 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:36.781166 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:36.783280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:36.791902 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:36.792357 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:36.793155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:36.793789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:37.018619 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:37.033350 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b288f647-6a3f-4100-bf79-81e692571ba7 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.262623 Jul 18 15:16:37.034945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 210/424] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:36 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:37.796553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:37.808261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:37.831598 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:37.832897 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:37.834490 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:37.835881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:37.882885 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-02749edd-c921-443b-9599-5a96b3b741e0 req-3ce65789-4b4c-4bbc-82e3-7b5de9c43607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a0f350-00e1-4487-a61f-6c95c33c4682", "tag": "feb630d5-c06f-4374-a746-0b9a1f6c54be"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:37.917132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-02749edd-c921-443b-9599-5a96b3b741e0 req-3ce65789-4b4c-4bbc-82e3-7b5de9c43607 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:37.917938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-02749edd-c921-443b-9599-5a96b3b741e0 req-3ce65789-4b4c-4bbc-82e3-7b5de9c43607 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:37.936545 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-02749edd-c921-443b-9599-5a96b3b741e0 req-3ce65789-4b4c-4bbc-82e3-7b5de9c43607 service nova] Creating event network-changed:feb630d5-c06f-4374-a746-0b9a1f6c54be for instance a2a0f350-00e1-4487-a61f-6c95c33c4682 on hv-cinder-83697 Jul 18 15:16:37.943011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-02749edd-c921-443b-9599-5a96b3b741e0 req-3ce65789-4b4c-4bbc-82e3-7b5de9c43607 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070099 Jul 18 15:16:37.944713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 211/425] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:38.060010 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:38.060797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:38.075903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:38.077287 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:38.080283 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:38.081204 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:38.260920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:38.324392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:38.332657 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:38.340497 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-09823b9e-dc39-467b-96b5-722d34eab96d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.557578 Jul 18 15:16:38.348550 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 215/426] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:37 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:38.375992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-c0b0e887-b529-45cd-9e57-c7a6543fcf16 req-8580da4e-bf07-45ad-837d-4895563c18e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea90bbda-13c2-40f9-bd93-daa1e79f27dd", "tag": "e9e943a0-f833-4d66-8068-fd9533d671de"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:38.440669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-c0b0e887-b529-45cd-9e57-c7a6543fcf16 req-8580da4e-bf07-45ad-837d-4895563c18e3 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:38.441459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-c0b0e887-b529-45cd-9e57-c7a6543fcf16 req-8580da4e-bf07-45ad-837d-4895563c18e3 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:38.476041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-c0b0e887-b529-45cd-9e57-c7a6543fcf16 req-8580da4e-bf07-45ad-837d-4895563c18e3 service nova] Creating event network-changed:e9e943a0-f833-4d66-8068-fd9533d671de for instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd on hv-cinder-83697 Jul 18 15:16:38.483080 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-c0b0e887-b529-45cd-9e57-c7a6543fcf16 req-8580da4e-bf07-45ad-837d-4895563c18e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132280 Jul 18 15:16:38.484040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 216/427] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:38.872276 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2033587780"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:38.875719 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:38.888587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:38.896574 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:38.898001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:38.899635 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:38.900422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:38.909647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-84f622f7-d437-4f09-8ee6-037668a12181 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.860076 Jul 18 15:16:38.910991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 212/428] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:38 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:39.347282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.network.security_group_api [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Adding security group d88d86b2-802a-40db-9aad-c10f341ebe26 to port b7362e28-3d73-4fdc-b428-2c67c361b97e Jul 18 15:16:39.387998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:39.389324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:39.416075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:39.425872 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:39.435564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:39.438329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:39.929145 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:39.942153 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:39.948900 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:39.966526 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-369f875b-4f68-4372-b3a8-0a7fdc77a62f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.575161 Jul 18 15:16:39.966526 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 213/429] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:39 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:39.966526 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:39.967566 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:39.981663 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:39.987246 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:39.988483 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:39.989063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:40.444809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:40.466462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:40.481365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-64d5cd9b-2e29-4659-895b-e60d267314fb tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.524762 Jul 18 15:16:40.484760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 214/430] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:39 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:40.493922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b6b78e75-f56d-4566-a248-0ddc6019ccae tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/action" status: 202 len: 0 microversion: 2.1 time: 1.638576 Jul 18 15:16:40.495009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 217/431] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:16:38 2022] POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/action => generated 0 bytes in 1643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 15:16:40.505154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:40.505744 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:40.520560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-8b795054-5641-4115-a89a-9e1ef67921e2 req-a3f5059e-ee67-47d7-bff2-cea5b338b71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:40.524811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:40.527919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:40.529586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:40.530477 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:40.538836 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8b795054-5641-4115-a89a-9e1ef67921e2 req-a3f5059e-ee67-47d7-bff2-cea5b338b71e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:40.539470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8b795054-5641-4115-a89a-9e1ef67921e2 req-a3f5059e-ee67-47d7-bff2-cea5b338b71e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:40.558141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-8b795054-5641-4115-a89a-9e1ef67921e2 req-a3f5059e-ee67-47d7-bff2-cea5b338b71e service nova] Creating event network-changed:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:16:40.579534 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-8b795054-5641-4115-a89a-9e1ef67921e2 req-a3f5059e-ee67-47d7-bff2-cea5b338b71e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062872 Jul 18 15:16:40.586100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 218/432] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:16:41.007952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:41.015629 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:41.018173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=8 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:41.032120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:41.032715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:41.035139 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:41.035737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:41.065917 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:41.095369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c1e39e7d-d27c-4de8-b9d9-ac933157c31a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1762 microversion: 2.1 time: 0.594177 Jul 18 15:16:41.096394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 215/433] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:40 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1762 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:41.346383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:41.366405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:41.369789 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:41.372905 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-61e172a9-40bd-4a83-99f3-d9f35dfd35c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.376218 Jul 18 15:16:41.374002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 219/434] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:40 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:41.511129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:41.512269 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:41.517667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:41.522903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:41.524348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:41.525274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:41.525996 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:41.872743 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:41.885764 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b595761a-dd2f-49a1-8998-a33f4973b371 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.380349 Jul 18 15:16:41.887408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 216/435] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:41 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:42.405819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:42.406872 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:42.415675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:42.416132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:42.416956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:42.417397 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:42.613754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:42.630577 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:42.635820 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:42.639128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9104f60f-d037-411a-9d59-6011f164aa16 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.239194 Jul 18 15:16:42.642966 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 220/436] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:42 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:42.906832 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:42.907807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:42.909388 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=8 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:42.916290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:42.916736 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:42.917798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:42.918241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:43.116023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:43.133722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d0dba7ac-b429-47e9-a61b-b22d1053a133 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.230950 Jul 18 15:16:43.134856 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 217/437] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:42 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:43.667135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:43.668539 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:43.676911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:43.677369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:43.678172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:43.679172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:43.950567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:43.963684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:43.965615 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:43.966910 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-25858eb8-8281-4a44-bd70-7fc4b4bde44b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.306496 Jul 18 15:16:43.967520 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 221/438] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:43 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:44.158374 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:44.159346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:44.169796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:44.170433 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:44.171969 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:44.171969 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:44.409176 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:44.426775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-669e0dc8-bff2-4212-a008-45adb2b7d065 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.275138 Jul 18 15:16:44.427422 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 218/439] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:44 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:44.994067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:45.001407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:45.002620 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:45.003079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:45.003887 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:45.004323 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:45.029220 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:45.247967 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:45.267028 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:45.271952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:45.275270 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-645998d5-c9ed-46ef-a5e3-636d8789e5a0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.285907 Jul 18 15:16:45.290409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 222/440] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:44 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:45.449130 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:45.449983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:45.456513 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:45.457163 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:45.457944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:45.458361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:45.712530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:45.721682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b064eb7b-4ac0-4320-a5f5-75e6857d666c tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.278267 Jul 18 15:16:45.723100 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 219/441] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:45 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:46.315411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:46.316585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:46.335663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:46.336492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:46.338265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:46.339021 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:46.611285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:46.636563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:46.638223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:46.639535 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e511adc7-67f4-4b87-a04d-7cfbd22b7704 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1751 microversion: 2.20 time: 0.334700 Jul 18 15:16:46.644513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 223/442] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:46 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1751 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:46.751841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:46.753002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:46.766190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:46.767395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:46.769054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:46.770064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:46.969155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:46.980307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0d2b6368-c173-43de-b850-31af6f453a52 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.236868 Jul 18 15:16:46.981563 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 220/443] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:46 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:47.670230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:47.671331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:47.683472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:47.684196 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:47.685504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:47.686291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:47.915023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:47.938869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:47.941486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:47.943498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef5c42ff-17f9-4f0e-943b-d5dbd62f186e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1753 microversion: 2.20 time: 0.281373 Jul 18 15:16:47.944982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 224/444] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:47 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1753 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:48.002487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:48.003852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:48.016851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:48.017717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:48.019275 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:48.020065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:48.254118 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:48.266388 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-846914d4-7cd4-440a-824e-431d2f06a190 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.270916 Jul 18 15:16:48.272906 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 221/445] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:47 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:48.966023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:48.967386 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:48.975999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:48.977128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:48.978171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:48.978638 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:49.177539 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:49.193437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:49.196665 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:49.198669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-033d34df-fea2-4688-a555-4080e5cd1d8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1753 microversion: 2.20 time: 0.237758 Jul 18 15:16:49.199810 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 225/446] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:48 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1753 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:49.286112 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:49.286972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:49.295785 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:49.296245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:49.297082 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:49.297815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:49.512116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:49.526682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d3184adc-d926-441a-8956-b9579055fd56 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.245125 Jul 18 15:16:49.527792 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 222/447] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:49 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:50.219180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:50.219813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:50.227315 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:50.227773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:50.228581 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:50.229825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:50.417497 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:50.436877 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:50.442903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:50.444132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cde0b77b-0fc1-4585-a8d4-217b34103ef7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.227855 Jul 18 15:16:50.459721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 226/448] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:50 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:50.549952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:50.552168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:50.564044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:50.564503 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:50.565492 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:50.566352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:50.703799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-0118d99b-ed12-44e9-8c7f-6dd72160a3f4 req-307a84ec-fb99-44d3-bf80-6fb1e6911ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a0f350-00e1-4487-a61f-6c95c33c4682", "name": "network-vif-plugged", "status": "completed", "tag": "feb630d5-c06f-4374-a746-0b9a1f6c54be"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:50.713501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0118d99b-ed12-44e9-8c7f-6dd72160a3f4 req-307a84ec-fb99-44d3-bf80-6fb1e6911ac0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:50.713986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0118d99b-ed12-44e9-8c7f-6dd72160a3f4 req-307a84ec-fb99-44d3-bf80-6fb1e6911ac0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:50.727684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-0118d99b-ed12-44e9-8c7f-6dd72160a3f4 req-307a84ec-fb99-44d3-bf80-6fb1e6911ac0 service nova] Creating event network-vif-plugged:feb630d5-c06f-4374-a746-0b9a1f6c54be for instance a2a0f350-00e1-4487-a61f-6c95c33c4682 on hv-cinder-83697 Jul 18 15:16:50.734786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-0118d99b-ed12-44e9-8c7f-6dd72160a3f4 req-307a84ec-fb99-44d3-bf80-6fb1e6911ac0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037717 Jul 18 15:16:50.736065 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 227/449] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:16:50.875826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:50.885419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e7338151-b6ea-4879-b64d-bb6c69a585f3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.343317 Jul 18 15:16:50.900618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 223/450] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:50 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:51.476237 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:51.479427 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:51.492929 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:51.494413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:51.496383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:51.497596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:51.779369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:51.779369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:51.780046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:51.781279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bc150d1d-70ab-4753-a7a6-65e54ca9116f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.314428 Jul 18 15:16:51.781863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 228/451] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:51 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:51.904470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:51.906109 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:51.914648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:51.915121 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:51.916114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:51.916569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:52.207111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:52.226999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dc224282-bfb4-4708-8313-10a2afbdc73d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.325534 Jul 18 15:16:52.228122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 224/452] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:51 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:52.805360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:52.807335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:52.817672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:52.820265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:52.831432 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:52.834295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:53.067261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:53.078893 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:53.080435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:53.081847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7afb2235-fd89-4826-bff6-97ef0af3373d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.284055 Jul 18 15:16:53.082438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 229/453] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:52 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:53.250689 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:53.251961 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:53.264965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:53.265739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:53.267283 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:53.268200 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:53.465719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:53.476072 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4e4bbfd4-c350-4afe-bd37-fd9b41b7d3a2 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.233409 Jul 18 15:16:53.476072 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 225/454] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:53 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:54.101753 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:54.102399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:54.113971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:54.114748 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:54.116628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:54.117404 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:54.304708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:54.324494 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:54.329463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:54.332056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c62b3f77-22c0-4de8-990b-c17bf99b815d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.234165 Jul 18 15:16:54.333108 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 230/455] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:54 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:54.496022 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:54.497101 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:54.504284 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:54.504736 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:54.505523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:54.505958 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:54.676925 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:54.685721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3a66ca34-1ad8-4dd0-aa3f-fbc2b69e226a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.195418 Jul 18 15:16:54.686346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 226/456] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:54 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:55.357329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:55.358308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:55.375124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:55.375893 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:55.379559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:55.379559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:55.612713 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:55.630722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:55.633875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:55.635261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-be3a58b1-a3d3-45b4-9bf7-2a56070c5434 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.285320 Jul 18 15:16:55.636473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 231/457] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:55 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:55.714580 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:55.716197 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:55.733778 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:55.735083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:55.737486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:55.738308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:55.749730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:16:55.986478 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:56.007966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8de16227-c4de-4241-93b4-2bb060338617 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.305400 Jul 18 15:16:56.008580 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 227/458] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:55 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:56.666390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:56.667143 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:56.674111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:56.674630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:56.675405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:56.675842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:56.845291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:56.856148 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:56.857830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:56.859116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2ab5c37b-84c7-4f16-8948-28d8f9f399cb tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.198084 Jul 18 15:16:56.860130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 232/459] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:56 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:16:57.028275 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:57.028975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:57.035659 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:57.036115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:57.036911 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:57.037360 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:57.285674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:57.307735 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f58e1629-ed86-4efa-8a5f-b0b5beda5cfa tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.283380 Jul 18 15:16:57.308870 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 228/460] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:57 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:16:57.879315 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:57.880437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:57.892065 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:57.892510 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:57.893321 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:57.893767 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:58.081684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:58.095211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:58.098620 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:58.100943 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2b7f21b6-8bea-4f01-bac4-57ad8f40e2ce tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.225413 Jul 18 15:16:58.102252 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 233/461] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:57 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:58.276251 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1391780611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-483268862", "security_groups": [{"name": "tempest-secgroup-smoke-444152500"}], "networks": [{"uuid": "14fcb8a1-b1b9-474b-bda1-1b0216c603a1"}], "block_device_mapping_v2": [{"uuid": "e76d7fb3-e110-4aec-88c4-94f1fcb12216", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:16:58.331863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:58.332685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:58.342472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:58.349538 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:58.350178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:58.351991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:58.490194 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] validate_networks() for [('14fcb8a1-b1b9-474b-bda1-1b0216c603a1', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:16:58.561869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:58.571329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-64505d2d-b282-4693-b3af-64f4622c8646 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.243417 Jul 18 15:16:58.572983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 234/462] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:58 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:59.035039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:16:59.035474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:16:59.035987 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:16:59.036404 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:16:59.036819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:16:59.048666 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:59.049101 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:59.049895 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:59.050340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:59.073804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Getting quotas for project 5c88f3beb8bf468f9a30311b203b13cf. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:16:59.077903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Getting quotas for user dcfdd71f9b93426bb6b149d2aeb2088e and project 5c88f3beb8bf468f9a30311b203b13cf. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:16:59.121161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:59.122055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:59.128933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:59.129568 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:59.130783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:59.131239 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:59.149340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:16:59.150514 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e76d7fb3-e110-4aec-88c4-94f1fcb12216',volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:16:59.333602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:59.344345 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:59.346565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:59.348150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4c1a9b2b-b81d-4694-a331-387308aad453 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.231217 Jul 18 15:16:59.349211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 235/463] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:16:59 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:16:59.589976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:59.596178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:59.599029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:59.599907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:59.600920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:16:59.601698 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:16:59.727257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d7900e20-9194-4e60-84b2-687d5d6ab458 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.455998 Jul 18 15:16:59.729016 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 229/464] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:16:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 15:16:59.748157 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dce8094c-089d-4666-9c76-b455ec3b15ad tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:16:59.755430 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dce8094c-089d-4666-9c76-b455ec3b15ad tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:16:59.854963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:59.865509 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fd69b031-4a92-4efa-82c6-65eba74ff6a5 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.280991 Jul 18 15:16:59.885387 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 236/465] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:59 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:16:59.896414 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dce8094c-089d-4666-9c76-b455ec3b15ad tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:16:59.915933 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dce8094c-089d-4666-9c76-b455ec3b15ad tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1088 microversion: 2.1 time: 0.177315 Jul 18 15:16:59.916796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 230/466] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:16:59 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1088 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:00.381778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:00.383109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:00.403085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:00.403560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:00.404347 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:00.404789 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:00.623242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:00.637951 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:00.640117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:00.641519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-073f3a76-96ab-43b6-98a5-ad14d9741f4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.263978 Jul 18 15:17:00.642282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 237/467] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:00 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:00.929327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:00.929327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:00.929327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:00.929327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:00.930643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:00.930643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:00.937519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2680bc82-a534-4cec-8ffd-fd643472efc4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:00.938310 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2680bc82-a534-4cec-8ffd-fd643472efc4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:01.039220 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2680bc82-a534-4cec-8ffd-fd643472efc4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:01.051812 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2680bc82-a534-4cec-8ffd-fd643472efc4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1088 microversion: 2.1 time: 0.118924 Jul 18 15:17:01.052819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 238/468] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:00 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1088 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:01.150783 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:01.166602 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c7a4891e-72e7-4e36-8d70-57431af5f3dd tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.275926 Jul 18 15:17:01.167828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 231/469] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:00 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:01.672978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:01.696500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:01.711151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:01.712110 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:01.713264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:01.714367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:02.006192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:02.024018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:02.025784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:02.033567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-629a4083-7279-4e8e-ad27-9de6c5ee571d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.367854 Jul 18 15:17:02.035308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 239/470] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:01 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:02.085095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:02.085874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:02.094734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:02.098582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:02.098582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:02.098582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:02.176951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:02.185726 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:02.186352 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:02.188886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2f3f8211-8662-4b36-8ee0-000a418af6e4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1138 microversion: 2.1 time: 0.107887 Jul 18 15:17:02.189799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 232/471] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:02 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:02.193113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:02.193819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:02.195243 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:02.195690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:02.347000 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:02.352686 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:02.358836 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-69ac4e2d-ca4b-40da-abeb-7d261e947d98 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.176878 Jul 18 15:17:02.359456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 240/472] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:02 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:03.055158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:03.055717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:03.064062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:03.064513 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:03.065330 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:03.065768 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:03.222089 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:03.223543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:03.235339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:03.236990 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:03.238973 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:03.239799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:03.259167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:03.271716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:03.274635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:03.275890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d7ccc8a5-0898-4487-8aa7-17ca161c2715 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.226783 Jul 18 15:17:03.277377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 233/473] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:03 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:03.345043 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:03.357907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f3e983e1-7936-4d21-a320-8c244a99ca63 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1138 microversion: 2.1 time: 0.143735 Jul 18 15:17:03.359042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 241/474] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:03 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1138 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:03.386263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:03.386968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:03.394047 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:03.394646 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:03.395478 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:03.395930 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:03.599286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:03.604783 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-111a06f5-e565-4951-9073-e3d7f940a13a tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.222967 Jul 18 15:17:03.606014 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 234/475] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:03 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:04.307185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:04.307819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:04.314683 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:04.316587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:04.316587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:04.316587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:04.381045 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:04.383833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:04.391521 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:04.391975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:04.393739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:04.394195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:04.481519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:04.482139 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:04.490176 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cd726783-9be6-43a0-9ca0-5ffe50493b83 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1186 microversion: 2.1 time: 0.116894 Jul 18 15:17:04.490845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 235/476] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:04 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1186 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:04.492515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:04.494180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:04.495717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fe639313-6437-4331-b156-b6fb3af15d04 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.194499 Jul 18 15:17:04.496504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 242/477] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:04 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:17:04.635645 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:04.636731 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:04.647655 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:04.652421 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:04.652421 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:04.652421 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:04.862315 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:04.871391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bbbda771-96f3-4c8f-820d-ec84a369f958 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.244263 Jul 18 15:17:04.876909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 236/478] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:04 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:05.512567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:05.514810 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:05.517667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:05.519112 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:05.528124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:05.528675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:05.529598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:05.529934 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:05.530143 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:05.530523 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:05.530909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:05.531359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:05.621695 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:05.631003 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3254d5ac-49ec-40e4-bc53-909234f7bc9f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1186 microversion: 2.1 time: 0.125479 Jul 18 15:17:05.632385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 243/479] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:05 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1186 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:05.745455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:05.759827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:05.762240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:05.763624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4e10b527-bac3-4e6a-8fc0-7cb8b6f8490a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.251524 Jul 18 15:17:05.764359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 237/480] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:05 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:05.889814 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:05.890432 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:05.897493 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:05.898464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:05.899426 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:05.899873 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:06.099637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:06.114388 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-57186542-10ce-497a-92f0-433de4f515d8 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.228142 Jul 18 15:17:06.115501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 244/481] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:05 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:06.650671 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:06.651358 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:06.661121 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:06.662450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:06.666017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:06.666739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:06.758990 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:06.769335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9d537ddf-275f-445e-9fef-71e7827d0c09 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1186 microversion: 2.1 time: 0.123358 Jul 18 15:17:06.769962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 238/482] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:06 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1186 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:06.784838 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:06.786073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:06.795050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=86 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:06.806366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:06.806865 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:06.807942 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:06.808250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.326616 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:07.326616 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:07.328956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:07.328956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6d4fc44d-6744-418e-a075-20c9e4af2e4a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.252043 Jul 18 15:17:07.328956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 245/483] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:06 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:07.329674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:07.329674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:07.329674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:07.329674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.330115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:07.330115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.330115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:07.330395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4e3f3b68-52b1-4677-a8af-c224260259d3 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1313 microversion: 2.1 time: 0.197664 Jul 18 15:17:07.330395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 239/484] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:07 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:07.787875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:07.789062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:07.795321 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:07.795810 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.796618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:07.797064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.868119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:07.868119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:07.878735 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:07.879040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:07.879444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.880926 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:07.882261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:07.889681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-343a9887-8204-47b5-ba17-45f6d164ecd7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1186 microversion: 2.1 time: 0.106082 Jul 18 15:17:07.890423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 246/485] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:07 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:08.052305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:08.053025 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:08.061793 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.062418 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.063296 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.064035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.083225 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lazy-loading 'services' on Instance uuid 9f39d887-9b8a-4bda-9ddc-83c684c699f5 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:17:08.332425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:08.347976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:08.349666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:08.351663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f9e86287-8937-43c4-ba8c-ec0aa88a2e4e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.303514 Jul 18 15:17:08.352262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 247/486] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:08 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:17:08.357730 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:08.359524 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:08.372256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.372256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.372256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.372256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.468434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0e57b747-e12f-4af8-92b4-188c937e417b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-volume_attachments/365074e3-0536-4633-9173-c70e1fb366a2" status: 202 len: 0 microversion: 2.1 time: 0.619870 Jul 18 15:17:08.471587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 240/487] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:17:07 2022] DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-volume_attachments/365074e3-0536-4633-9173-c70e1fb366a2 => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 15:17:08.481828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:08.483283 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:08.500355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.500355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.500355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.500355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.761593 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-006c5edf-8f9e-40d1-add2-80967305bcf4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/action" status: 202 len: 0 microversion: 2.1 time: 0.404644 Jul 18 15:17:08.766334 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 248/488] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:17:08 2022] POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:17:08.784708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:08.786069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:08.800931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.802066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:08.802260 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:08.802750 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:09.061105 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:09.071532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:09.083860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d5dbb4a9-6421-4909-87c9-9a53592b0e01 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1496 microversion: 2.1 time: 0.609776 Jul 18 15:17:09.084534 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 241/489] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:08 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1496 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:09.103392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:09.104417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:09.115100 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:09.116756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:09.117829 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:09.118675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:09.213767 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:09.227054 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-65aef639-da70-4a50-b45e-dbce86e1c100 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1754 microversion: 2.1 time: 0.457434 Jul 18 15:17:09.235192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 249/490] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:08 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1754 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:09.245074 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:09.254860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-37445707-aa1e-48a2-af26-13d735a5995f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1204 microversion: 2.1 time: 0.160069 Jul 18 15:17:09.255740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 242/491] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:09 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1204 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:09.415715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:09.421703 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:09.445398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:09.453564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:09.453564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:09.453564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:09.651722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:09.670812 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:09.673088 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:09.674834 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-50defb94-5d8a-4b07-9e52-f4d20915b590 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.284545 Jul 18 15:17:09.676381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 250/492] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:09 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:10.258337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:10.259034 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:10.261605 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=8 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:10.267214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.267582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.268394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.269021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.285543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:10.291717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:10.299087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.299622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.301022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.301775 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.439466 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:10.457546 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c0c52de3-8806-477d-8ad1-50e6ccf0ddac tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1204 microversion: 2.1 time: 0.172796 Jul 18 15:17:10.458255 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 251/493] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:10 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1204 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:10.666316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:10.667247 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:10.698705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.699613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.701382 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.701890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:10.702851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.717820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f760096c-00d8-44f2-95d5-623dba8b1141 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1754 microversion: 2.1 time: 0.464139 Jul 18 15:17:10.719546 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 243/494] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:10 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1754 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:10.725769 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:10.727054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:10.780873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.781629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.783192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:10.784004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:10.849282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:17:11.046491 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:11.286579 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:11.327106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:11.327106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:11.327106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:11.331450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fe0a6b1b-a91b-4ca5-9cea-d3c0b609f340 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.598482 Jul 18 15:17:11.331450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 244/495] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:10 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:11.368209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-61852e67-654c-4f67-8d5f-76a3bf12a27b tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 204 len: 0 microversion: 2.1 time: 0.710804 Jul 18 15:17:11.376220 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 252/496] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:17:10 2022] DELETE /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 15:17:11.391653 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:11.391653 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:11.398278 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:11.398779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:11.399605 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:11.400028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:11.492742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:11.494271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:11.513395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:11.513395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:11.513395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:11.513395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:11.609575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:11.624769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-954dcc24-a102-4257-b8ac-57d7945bd3e5 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1204 microversion: 2.1 time: 0.138859 Jul 18 15:17:11.625560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 253/497] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:11 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1204 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:11.739725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:11.749847 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4eb89a41-ad89-43ab-bdb0-efcd7470cd12 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1502 microversion: 2.1 time: 0.367579 Jul 18 15:17:11.761878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 245/498] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:11 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1502 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:11.762445 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:11.762445 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:11.769291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:11.770061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:11.770958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:11.771408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.076956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6a5cb8da-b870-45b4-9e21-7299919f7d07 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:12.090723 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6a5cb8da-b870-45b4-9e21-7299919f7d07 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.092257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6a5cb8da-b870-45b4-9e21-7299919f7d07 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.137231 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:12.143155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:12.157048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-82275a87-7f33-45b3-8fb0-0540c44b4e24 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1754 microversion: 2.1 time: 0.401003 Jul 18 15:17:12.157048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 254/499] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:11 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1754 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:12.168528 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6a5cb8da-b870-45b4-9e21-7299919f7d07 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Going to try to stop instance {{(pid=118339) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 15:17:12.340337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:12.340955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:12.348465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.348931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.349761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.350262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.447981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6a5cb8da-b870-45b4-9e21-7299919f7d07 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action" status: 202 len: 0 microversion: 2.1 time: 0.383213 Jul 18 15:17:12.448828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 246/500] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:17:12 2022] POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:17:12.459725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:12.461637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:12.474916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.477000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.479656 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.480165 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.640687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:12.655467 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:12.658423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:12.660252 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-57b700dc-3f96-44b3-8acc-98a7580e1c8b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.324665 Jul 18 15:17:12.661423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 255/501] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:12 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:17:12.673763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:12.675894 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:12.688367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.688849 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.689697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.690119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.690311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:12.702420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f856fc8e-8a9a-43e3-bd57-06b3b9fd2b62 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.248203 Jul 18 15:17:12.703809 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 247/502] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:12 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:12.777167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:12.777858 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:12.786298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.787417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:12.789201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:12.790006 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.038257 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:13.057623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-13940712-4592-4ad3-a79f-5543b7fd15b4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1271 microversion: 2.1 time: 0.392672 Jul 18 15:17:13.068422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 256/503] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:12 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1271 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:13.166480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:13.173842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:13.174126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-471892e6-b7d9-4941-90f6-cbaf8a279283 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1502 microversion: 2.1 time: 0.401508 Jul 18 15:17:13.174470 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:13.175352 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 248/504] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:12 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:13.192349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:13.194889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.194889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:13.194889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.447496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:13.463634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-263bff23-d011-429c-bc5f-bb2b8bec7b42 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1754 microversion: 2.1 time: 0.294249 Jul 18 15:17:13.465951 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 257/505] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:13 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1754 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:13.695347 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:13.696496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:13.703850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:13.704286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.705163 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:13.705617 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.725123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:13.727134 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:13.747182 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:13.748706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.751030 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:13.751954 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:13.992631 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:14.003947 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:14.005559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:14.007420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9e97e34a-5f34-48c2-8222-5fadd4ec4848 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.316854 Jul 18 15:17:14.020842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 249/506] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:13 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:17:14.078347 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:14.079014 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:14.092641 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.128782 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.128782 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.128782 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.317728 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:14.327214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5cdb60f2-2c81-47fe-be85-7fc758556a87 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1271 microversion: 2.1 time: 0.252713 Jul 18 15:17:14.327816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 250/507] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:14 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1271 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:14.332987 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:14.333807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:14.336564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:14.342747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.343340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.344294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.345062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.520837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:14.533077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bf33eb37-0fc4-460b-8b7b-1c11f4b58c04 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.812361 Jul 18 15:17:14.535761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 258/508] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:13 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:14.549885 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:14.550955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:14.573139 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.574049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.578983 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.579805 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.663034 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:14.703791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f71c51b2-83f2-4f8d-bef0-e1d4a24c2179 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1502 microversion: 2.1 time: 0.371401 Jul 18 15:17:14.706062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 251/509] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:14 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:14.714725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-a10b1efd-f7b2-4468-b72f-75b6087eadc0 req-bdaf1025-7b48-426d-9ab9-3ea626c571d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:14.738578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a10b1efd-f7b2-4468-b72f-75b6087eadc0 req-bdaf1025-7b48-426d-9ab9-3ea626c571d5 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:14.739661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a10b1efd-f7b2-4468-b72f-75b6087eadc0 req-bdaf1025-7b48-426d-9ab9-3ea626c571d5 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:14.762920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-a10b1efd-f7b2-4468-b72f-75b6087eadc0 req-bdaf1025-7b48-426d-9ab9-3ea626c571d5 service nova] Creating event network-changed:235acfe0-1c77-4d1b-a14c-fd642227cae1 for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e on hv-cinder-83697 Jul 18 15:17:14.784529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-a10b1efd-f7b2-4468-b72f-75b6087eadc0 req-bdaf1025-7b48-426d-9ab9-3ea626c571d5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075660 Jul 18 15:17:14.785171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 252/510] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:15.038453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:15.039675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:15.053038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.055397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.071341 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.073247 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.173954 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:15.199447 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-aa62e7cc-0b6b-4ed9-8e20-76cdb98591fd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.661413 Jul 18 15:17:15.211274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 259/511] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:14 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:15.219780 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-8bfb2136-ce2c-4689-99c6-35a7a1a3a638 req-6b9f643a-2869-44ab-b580-e7f426989966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "name": "network-vif-plugged", "status": "completed", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:15.230626 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8bfb2136-ce2c-4689-99c6-35a7a1a3a638 req-6b9f643a-2869-44ab-b580-e7f426989966 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.231527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8bfb2136-ce2c-4689-99c6-35a7a1a3a638 req-6b9f643a-2869-44ab-b580-e7f426989966 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.246184 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-8bfb2136-ce2c-4689-99c6-35a7a1a3a638 req-6b9f643a-2869-44ab-b580-e7f426989966 service nova] Creating event network-vif-plugged:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:17:15.252124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-8bfb2136-ce2c-4689-99c6-35a7a1a3a638 req-6b9f643a-2869-44ab-b580-e7f426989966 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 Jul 18 15:17:15.256757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 260/512] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:15.346587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:15.347750 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:15.374991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.375838 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.377242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.378035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.637822 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:15.653153 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:15.655071 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:15.656351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-89bad185-8c0b-42c5-8a0b-3bced60a9a5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.623813 Jul 18 15:17:15.657652 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 253/513] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:15 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:17:15.664042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:15.665073 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:15.673548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.674305 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.676461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.677355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.724536 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:15.740444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7fcebaf6-0a29-41d8-9d33-72c8ed3f0226 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.399576 Jul 18 15:17:15.742686 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 261/514] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:15 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:15.765693 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-348e7ff2-36b1-4eed-a55c-cac69522b3f6 req-e82d21d7-aa78-40bc-a133-9a10dd730de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a0f350-00e1-4487-a61f-6c95c33c4682", "name": "network-vif-deleted", "tag": "feb630d5-c06f-4374-a746-0b9a1f6c54be"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:15.798103 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-348e7ff2-36b1-4eed-a55c-cac69522b3f6 req-e82d21d7-aa78-40bc-a133-9a10dd730de5 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.800430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-348e7ff2-36b1-4eed-a55c-cac69522b3f6 req-e82d21d7-aa78-40bc-a133-9a10dd730de5 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.821371 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-348e7ff2-36b1-4eed-a55c-cac69522b3f6 req-e82d21d7-aa78-40bc-a133-9a10dd730de5 service nova] Creating event network-vif-deleted:feb630d5-c06f-4374-a746-0b9a1f6c54be for instance a2a0f350-00e1-4487-a61f-6c95c33c4682 on hv-cinder-83697 Jul 18 15:17:15.831758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-348e7ff2-36b1-4eed-a55c-cac69522b3f6 req-e82d21d7-aa78-40bc-a133-9a10dd730de5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086386 Jul 18 15:17:15.832401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 262/515] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:15.846531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:15.847292 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:15.859557 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.860359 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.861427 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:15.862109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:15.972142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:15.988898 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ee899a06-4573-4f3d-9c7f-57eb01900827 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1460 microversion: 2.1 time: 0.152578 Jul 18 15:17:15.990362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 263/516] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:15 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1460 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:16.150644 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:16.161358 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1f3b12a4-7ac6-402f-bbbc-f5954c28cffa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.502399 Jul 18 15:17:16.172346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 254/517] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:15 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:16.232961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:16.235624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:16.250862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:16.252086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:16.270511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:16.275765 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:16.621305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:16.659202 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e7f915a5-034f-43c7-bad3-ccd0d51e3331 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.435826 Jul 18 15:17:16.664313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 264/518] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:16 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:16.699580 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:16.701481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:16.716729 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:16.717567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:16.722830 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:16.722830 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:16.795060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:16.796652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:16.804903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:16.806161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:16.807514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:16.808230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.103853 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:17.133763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:17.152660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:17.152660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-db0dbd67-526d-4c0f-a290-86836f1e1972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.451295 Jul 18 15:17:17.152660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 255/519] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:16 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:17:17.152660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:17.153679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:17.180626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.180626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.180626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.180626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.259749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.260215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.260733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lazy-loading 'fault' on Instance uuid a2a0f350-00e1-4487-a61f-6c95c33c4682 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:17:17.266130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:17.279613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-36989dc9-26f8-48dd-abf5-a8b3788d13d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.510706 Jul 18 15:17:17.280437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 265/520] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:16 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:17.286681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:17.287041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:17.297927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.298954 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.301496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.305342 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.450739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:17.462391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-38175765-5ad3-42c7-a2d9-68ad3df09410 tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1303 microversion: 2.1 time: 0.318584 Jul 18 15:17:17.467034 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 256/521] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:17 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1303 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:17.546833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:17.557569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-629b2ef3-4202-4971-b4c2-002ed366699b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.276108 Jul 18 15:17:17.563985 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 266/522] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:17 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:17.693638 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:17.694330 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:17.715725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.717294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:17.719180 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:17.720247 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.165101 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:18.166171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:18.189761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.197351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.197351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.197351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.314682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.332005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7efb8fc8-7113-42cd-8674-f9ffcd207cf0 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.642140 Jul 18 15:17:18.333012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 257/523] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:17 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:18.339502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:18.340597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:18.354528 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.355251 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.360148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.360148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.444326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.464543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.470469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.472968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-09e200d2-b3b5-47dc-8c34-de4c3de5c79e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.314867 Jul 18 15:17:18.474422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 267/524] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:18 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:18.497355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:18.498403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:18.505993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.507293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.509139 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.509857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.566622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.567329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.568058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lazy-loading 'fault' on Instance uuid a2a0f350-00e1-4487-a61f-6c95c33c4682 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:17:18.634782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa3eace09844298a4cf0373ddc74de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a5c5beef1a42f0ac47a1f540e55c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.645984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1d9a6918-3499-4313-a374-3ed3782163ba tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 200 len: 1303 microversion: 2.1 time: 0.163045 Jul 18 15:17:18.646608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 268/525] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:18 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:18.661465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:18.679496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:18.679496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.679496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.679496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:18.680008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:18.889307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.901280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-85e848d3-094b-4fdd-b656-b4cb24500867 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.248317 Jul 18 15:17:18.905051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:18.911264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 269/526] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:18 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:18.922471 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2f2ee453-b772-4011-89f6-af23e785e35b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.586929 Jul 18 15:17:18.927055 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 258/527] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:18 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:19.369083 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:19.370187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:19.379242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.379988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.380971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.382233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.504007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:19.504629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:19.514692 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.516408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.518610 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.519400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.673514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:19.701187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6714057a-a0fe-4b4f-b9bc-d2d16779d676 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.344989 Jul 18 15:17:19.702764 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 270/528] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:19 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:19.711704 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:19.712992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] [instance: a2a0f350-00e1-4487-a61f-6c95c33c4682] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:19.727507 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.728310 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.729717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.730498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.761116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] HTTP exception thrown: Instance a2a0f350-00e1-4487-a61f-6c95c33c4682 could not be found. Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Request method failure captured: Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 HTTP/1.1 Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XkdSasEjLCoTg1yOGxGRcOZijVCoP-PBgK79sMucMNhtVx5RRrMNn1P1uyxLW9VRfg74u8JfltPAODdIHmhZ9qIHBVmrQmrNs7HiAqsLUJv_PukapHgBkA2NNt8anRpuL5uBXT2BeYYUPGWye4Ci5Y-16NvERGiiCYYHnVmSNbInRs Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 43a5c5beef1a42f0ac47a1f540e55c21 Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesActionsTest-1092429143 Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:17:19.764860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/43a5c5beef1a42f0ac47a1f540e55c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/43a5c5beef1a42f0ac47a1f540e55c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_43a5c5beef1a42f0ac47a1f540e55c21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/43a5c5beef1a42f0ac47a1f540e55c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesActionsTest-1092429143 Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 43a5c5beef1a42f0ac47a1f540e55c21 Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesActionsTest-1092429143 Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesActionsTest-1092429143-project Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: faa3eace09844298a4cf0373ddc74de1 Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesActionsTest-1092429143-project Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance a2a0f350-00e1-4487-a61f-6c95c33c4682 could not be found. Jul 18 15:17:19.766307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': 'a2a0f350-00e1-4487-a61f-6c95c33c4682'} Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a0f350-00e1-4487-a61f-6c95c33c4682 could not be found. Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:17:19.767551 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a0f350-00e1-4487-a61f-6c95c33c4682 could not be found. Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a0f350-00e1-4487-a61f-6c95c33c4682 could not be found. Jul 18 15:17:19.769036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:17:19.770142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] Returning 404 to user: Instance a2a0f350-00e1-4487-a61f-6c95c33c4682 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:17:19.770142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a4031343-825c-497e-9292-5c594461641d tempest-VolumesActionsTest-1092429143 tempest-VolumesActionsTest-1092429143-project] 10.222.0.83 "GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682" status: 404 len: 111 microversion: 2.1 time: 0.062745 Jul 18 15:17:19.770142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 271/529] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:19 2022] GET /compute/v2.1/servers/a2a0f350-00e1-4487-a61f-6c95c33c4682 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:17:19.861536 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:19.879710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:19.883844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:19.886187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-58c5cae1-3a3e-4e1e-981a-0b8d66ae6981 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.394387 Jul 18 15:17:19.887463 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 259/530] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:19 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:19.919477 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:19.920416 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:19.937896 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.940111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.940111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.940111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.941361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:19.942262 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:19.956250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.956713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:19.957587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:19.959026 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:20.333518 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:20.342858 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:20.353798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-246f9b8b-1e57-40a6-9652-6f0359a4d948 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.417822 Jul 18 15:17:20.359338 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:20.369062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-22e1492a-957b-4e2b-948e-910cc9f2b1b9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.453789 Jul 18 15:17:20.369911 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 260/531] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:19 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:20.375457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 272/532] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:19 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:20.722806 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:20.723653 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:20.738245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:20.756931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:20.756931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:20.756931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:20.921881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:20.923155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:20.945833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:20.946297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:20.947158 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:20.947613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:20.953238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:21.215414 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:21.233063 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:21.235110 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:21.240486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dce04c73-6803-418f-966a-faf13dbb77dc tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1809 microversion: 2.20 time: 0.331377 Jul 18 15:17:21.251307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 273/533] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:20 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:21.322296 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:21.333570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-376d67fd-b42d-4342-a822-f49882e3d13d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.615196 Jul 18 15:17:21.334815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 261/534] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:20 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:21.379279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:21.384621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:21.390856 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:21.391279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:21.391717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:21.391932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:21.392865 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:21.393429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:21.408199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:21.408674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:21.409654 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:21.410108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:21.690593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:21.704059 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-46cf7e6a-ec9b-4aff-a730-a588349b5d0f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.318427 Jul 18 15:17:21.704678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 262/535] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:21 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:21.741341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:21.771960 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb738863-57ec-4270-9476-355587c5bca4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.397055 Jul 18 15:17:21.774717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 274/536] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:21 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:22.284195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:22.301837 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:22.320636 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.323141 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.323957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.324966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.358780 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:22.359597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:22.372089 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.372615 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.374796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.375563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.691409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:22.717242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3f528e91-3d19-4e65-a4e6-7541fe232900 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.362962 Jul 18 15:17:22.718161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 275/537] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:22 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:22.747166 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:22.750721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:22.752722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:22.759335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:22.766425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:22.767871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bd9a4bb1-9d43-4e25-91dd-91ae0b7a142a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1796 microversion: 2.20 time: 0.505213 Jul 18 15:17:22.768843 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 263/538] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:17:22 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1796 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:17:22.772978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.777526 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.784200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.784686 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.796908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:22.798078 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:22.842421 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.843155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:22.844676 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:22.845544 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:23.014265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:23.028641 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6db4c976-d0aa-450f-80cb-2549e059931c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.283626 Jul 18 15:17:23.030589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 276/539] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:22 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:23.186031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:23.197293 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-06220715-afcc-4b73-b826-e823bb5ea503 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.407494 Jul 18 15:17:23.198294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 264/540] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:22 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:23.751582 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:23.752377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:23.761423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:23.762801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:23.762801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:23.763069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:24.011437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:24.020661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ec3f3da4-ad5c-4536-991a-946368bf763a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.273027 Jul 18 15:17:24.022963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 277/541] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:23 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:24.049713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:24.052037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:24.061455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:24.062405 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:24.063410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:24.064075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:24.222194 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:24.223156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:24.231328 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:24.235348 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:24.235348 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:24.235348 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:24.253340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:24.264914 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a69ddc89-1696-4123-924a-c02bcd6a6360 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.219837 Jul 18 15:17:24.265643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 265/542] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:24 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:24.388762 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:24.396881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3738e1af-4d48-4b12-925d-a2cfef62aaef tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.179504 Jul 18 15:17:24.397548 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 278/543] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:24 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:25.041111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:25.042336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:25.051621 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:25.053375 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:25.055193 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:25.055859 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:25.289224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:25.291890 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:25.305837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:25.307228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:25.308906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:25.310009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:25.393309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:25.413807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-735e02c2-330d-4c38-8202-48aebb8e5c5a tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.377415 Jul 18 15:17:25.427334 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 266/544] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:25 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:25.447058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:25.448457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:25.473231 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:25.474054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:25.475616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:25.476525 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:25.795838 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:25.824100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-58e4ec91-9426-4418-9a2c-238dda15cfbd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.531508 Jul 18 15:17:25.824100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 279/545] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:25 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:25.825341 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:25.844453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c8e9f999-6d1d-418a-a218-04d3d5f53a5c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.414822 Jul 18 15:17:25.845938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 267/546] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:25 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:26.228329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1530572798", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "networks": [{"uuid": "40c301cd-c53a-4206-aeb7-9b2605a4022b"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:26.348229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] validate_networks() for [('40c301cd-c53a-4206-aeb7-9b2605a4022b', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:17:26.449844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:26.451129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:26.459868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:26.462656 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:26.464765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:26.465681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:27.176850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:17:27.177775 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:17:27.179044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:17:27.180062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:17:27.180674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:17:27.215816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:27.215816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:27.215816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:27.215816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:27.238051 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Getting quotas for project fcd59138153e461bb239770cc1bbc1f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:17:27.247916 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Getting quotas for user 4746f061cfd148609ffaf568f869d6d8 and project fcd59138153e461bb239770cc1bbc1f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:17:27.265815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:17:27.269229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:17:27.356575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:27.379844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-31714c7d-21ae-418b-9fa2-71cf7ec481c9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.926018 Jul 18 15:17:27.380528 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 268/547] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:26 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:27.391431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:27.400233 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:27.414158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:27.415496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:27.417034 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:27.417876 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:27.476226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2a8faf3f-2c67-4a38-835b-f94dd4f11e0e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260500 Jul 18 15:17:27.477570 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 280/548] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:17:27.536468 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:27.550738 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:27.577320 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:27.580677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:27.582204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:27.587794 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:28.009833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:28.016432 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:28.025491 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1e688535-bb91-4399-a82b-fd5a77437c4d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.547200 Jul 18 15:17:28.026119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 281/549] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:27 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:28.043147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b582bdc0-435b-4c2e-a0c7-88e3ce6a326b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.660924 Jul 18 15:17:28.044662 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 269/550] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:27 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:28.050371 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0235d1bb-9338-4ce9-8aa5-a3712a9828bc tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:28.052965 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0235d1bb-9338-4ce9-8aa5-a3712a9828bc tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:28.206071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0235d1bb-9338-4ce9-8aa5-a3712a9828bc tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:28.219797 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0235d1bb-9338-4ce9-8aa5-a3712a9828bc tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1219 microversion: 2.1 time: 0.181599 Jul 18 15:17:28.232968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 282/551] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:28 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:28.409451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:28.410093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:28.421985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:28.422452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:28.424270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:28.424743 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:28.793693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:28.832753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8c18b48c-d0a2-4282-8ca3-ba06474cb673 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.430618 Jul 18 15:17:28.850171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 270/552] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:28 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:29.046886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:29.047525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:29.060506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:29.071170 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:29.074944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:29.075335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.075335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:29.075834 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.080981 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:29.092987 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.093657 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:29.095304 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.103960 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:29.425302 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:29.437625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7fae3f63-a490-4a3e-9c03-e43d5856a9e6 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.372240 Jul 18 15:17:29.438223 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 271/553] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:29 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:29.450528 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d4c50995-5a34-4fce-9dc9-f10bf88559f8 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:29.459175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d4c50995-5a34-4fce-9dc9-f10bf88559f8 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:29.648681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d4c50995-5a34-4fce-9dc9-f10bf88559f8 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:29.660666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:29.662148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d4c50995-5a34-4fce-9dc9-f10bf88559f8 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1219 microversion: 2.1 time: 0.215605 Jul 18 15:17:29.665136 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 272/554] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:29 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:29.676224 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-d8fe895d-38b7-445e-b6fe-8973eac7826b req-891c4b47-d394-4dfe-8437-3e461cbdadd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "name": "network-vif-plugged", "status": "completed", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:29.697075 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c5d099bf-d737-42f7-b884-af20760b07ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.652958 Jul 18 15:17:29.706686 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 283/555] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:29 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:29.707067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-d8fe895d-38b7-445e-b6fe-8973eac7826b req-891c4b47-d394-4dfe-8437-3e461cbdadd3 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.707067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-d8fe895d-38b7-445e-b6fe-8973eac7826b req-891c4b47-d394-4dfe-8437-3e461cbdadd3 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:29.731497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-d8fe895d-38b7-445e-b6fe-8973eac7826b req-891c4b47-d394-4dfe-8437-3e461cbdadd3 service nova] Creating event network-vif-plugged:235acfe0-1c77-4d1b-a14c-fd642227cae1 for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e on hv-cinder-83697 Jul 18 15:17:29.740724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-d8fe895d-38b7-445e-b6fe-8973eac7826b req-891c4b47-d394-4dfe-8437-3e461cbdadd3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073791 Jul 18 15:17:29.742381 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 273/556] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:29.853869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:29.856109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:29.870990 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.871914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:29.872984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:29.874585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:30.234147 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:30.244150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5eae0ed9-e7a0-414b-88eb-8c992d8dacd2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.395896 Jul 18 15:17:30.245534 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 284/557] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:29 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:30.457643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:30.460663 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:30.472094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:30.472850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:30.473929 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:30.474864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:30.685599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:30.696914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:30.724069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:30.730469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:30.731533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:30.733696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:30.892367 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:30.906158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8c1dfccc-5303-45ed-8ec3-8d49527801ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1673 microversion: 2.1 time: 0.453835 Jul 18 15:17:30.910488 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 274/558] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:30 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1673 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:30.918752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:30.919709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:30.928198 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:30.930322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:30.931447 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:30.932014 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:31.219638 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:31.238404 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f17f4157-299d-4e4d-9ff2-2a591b617c4f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.324858 Jul 18 15:17:31.240018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 275/559] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:30 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:31.273433 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:31.274076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:31.290298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:31.291137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:31.292211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:31.292835 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:31.344325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:31.362269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e93642a7-a9aa-4bf9-a3db-edd2850975ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1215 microversion: 2.1 time: 0.683805 Jul 18 15:17:31.366733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 285/560] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:30 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1215 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:31.649624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:31.666452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c2356c7f-c63a-493d-93f7-fadbfbac3fbd tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1759 microversion: 2.1 time: 0.396052 Jul 18 15:17:31.667863 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 276/561] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:31 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1759 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:31.951970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f12db057-e3fd-4dab-b040-3cbd56cbacbf"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:31.952211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:31.954338 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:31.954951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:31.971134 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:31.972221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:31.974846 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:31.978773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:31.979350 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:31.979688 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:31.994774 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:31.996385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:32.360290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:32.377143 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ed6bb143-9fa8-47c7-9b3b-dd1c24472c5c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1650 microversion: 2.1 time: 0.439116 Jul 18 15:17:32.379420 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 286/562] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:31 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1650 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:32.386268 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:32.387395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:32.395612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:32.396438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:32.398043 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:32.399029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:32.660133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:32.696044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3a85e667-dbc2-42c3-bccf-20bafc93d080 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1259 microversion: 2.1 time: 0.313381 Jul 18 15:17:32.698734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 287/563] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:32 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1259 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:32.708400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:32.711099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:32.721659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:32.722500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:32.723755 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:32.724197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:32.886471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:32.907177 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c14ff80-286a-440b-8060-2785faa3f046 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1271 microversion: 2.1 time: 0.206879 Jul 18 15:17:32.917361 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 288/564] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:32 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:32.923090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f31a174b-305f-47aa-92ed-a906eb9aeda5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:32.930696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f31a174b-305f-47aa-92ed-a906eb9aeda5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:32.934836 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f31a174b-305f-47aa-92ed-a906eb9aeda5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:32.966005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f31a174b-305f-47aa-92ed-a906eb9aeda5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Going to try to start instance {{(pid=118340) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 15:17:33.371689 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f31a174b-305f-47aa-92ed-a906eb9aeda5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action" status: 202 len: 0 microversion: 2.1 time: 0.452545 Jul 18 15:17:33.374086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 289/565] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:17:32 2022] POST /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:17:33.390725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:33.391438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:33.432763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:33.433450 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:33.438019 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:33.440540 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:33.524746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:33.809587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:33.942916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-590685a9-d0ea-427c-9e20-f4f7128438d8 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.994582 Jul 18 15:17:33.955042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 277/566] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:17:31 2022] POST /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 194 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:33.978006 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:33.987938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:34.015925 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.020723 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.025293 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.031805 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.341417 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:34.369360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-58d40d22-2636-4df9-a77f-11116fb594fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1762 microversion: 2.1 time: 0.983996 Jul 18 15:17:34.382515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 290/567] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:33 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1762 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:34.389712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:34.391213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:34.400773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.401863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.406187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.407171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.727130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:34.737137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5ef41d20-029e-4e0d-af0c-2d0f22af28c3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1443 microversion: 2.1 time: 0.352176 Jul 18 15:17:34.744803 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:34.749329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 291/568] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:34 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1443 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:34.766766 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c051f0f8-5da4-4a09-8635-14353b6e0564 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1659 microversion: 2.1 time: 0.796238 Jul 18 15:17:34.781164 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:34.782391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 278/569] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:33 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1659 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:34.788591 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:34.790207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:34.793119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:34.801997 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.811285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.811285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.811285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.814248 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.815566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:34.816621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:34.817298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:35.127573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:35.149201 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-06ffe076-da6c-4325-b5df-d82c87f2500b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1277 microversion: 2.1 time: 0.378317 Jul 18 15:17:35.150558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 292/570] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:34 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1277 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:35.468473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:35.493964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8bb35794-110f-4c49-85b9-0e84f8a9f5ab tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1443 microversion: 2.1 time: 0.706831 Jul 18 15:17:35.507453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 279/571] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:34 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1443 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:35.813287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:35.816599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:35.828757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:35.830170 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:35.831571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:35.832464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:36.184006 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:36.185046 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:36.207935 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:36.208494 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:36.209420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:36.210517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:37.036351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:37.041393 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-35a50c24-d974-49a6-b8b5-9f55250348e5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.872928 Jul 18 15:17:37.042000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 280/572] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:36 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:37.219268 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:37.223855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:37.266894 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-42566d45-963c-40ae-ac2a-921b57e033ca tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1659 microversion: 2.1 time: 1.464605 Jul 18 15:17:37.268987 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 293/573] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:35 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1659 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:38.075712 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:38.076525 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:38.111586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:38.116633 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:38.116633 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:38.116633 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:38.290131 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:38.295021 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:38.331685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=8 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:38.336918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:38.337746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:38.339515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:38.340366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:39.189590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:39.208349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a3bb4c23-d374-484a-9475-301f713239fc tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1663 microversion: 2.1 time: 0.926198 Jul 18 15:17:39.229421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 294/574] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:38 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1663 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:39.623002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:39.670991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:39.700007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8a21abc3-3bc3-4672-853e-84b37789ecfd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 1.628175 Jul 18 15:17:39.706213 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 281/575] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:38 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:39.999874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-9c84b966-0d4b-48c4-82bb-bdd6970a54dc req-6ac0c4ad-9961-4152-903b-0a2bebcec63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e", "tag": "7378b582-67ac-41b6-ac1b-cfbd2f8feedd"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:40.042306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-9c84b966-0d4b-48c4-82bb-bdd6970a54dc req-6ac0c4ad-9961-4152-903b-0a2bebcec63a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:40.057741 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-9c84b966-0d4b-48c4-82bb-bdd6970a54dc req-6ac0c4ad-9961-4152-903b-0a2bebcec63a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:40.060462 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-86d5db10-f98d-43fd-8d27-9b55290a0c69 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Action: 'create', calling method: .version_select at 0x7f48c1dd49d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-577847118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIBYJ6C6SvXZqF2uraYkmhzaSANSI0YyefCojaDbn8W8L/ndDdrjc14ajWi3C8t7iQOTxu6Vz+yDJYAZZJ5NO0B/DnAN4TC92tKntAtn7YDVSWVO3VJfR4qJprZnC6ow=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:40.117840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-9c84b966-0d4b-48c4-82bb-bdd6970a54dc req-6ac0c4ad-9961-4152-903b-0a2bebcec63a service nova] Creating event network-changed:7378b582-67ac-41b6-ac1b-cfbd2f8feedd for instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e on hv-cinder-83697 Jul 18 15:17:40.153155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-9c84b966-0d4b-48c4-82bb-bdd6970a54dc req-6ac0c4ad-9961-4152-903b-0a2bebcec63a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162724 Jul 18 15:17:40.153155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 282/576] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:17:40.155436 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-86d5db10-f98d-43fd-8d27-9b55290a0c69 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for project 94513773e0c94187bbdaeb82c7304eae. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:17:40.165519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-86d5db10-f98d-43fd-8d27-9b55290a0c69 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for user 6bfa2a00688d4eab993059ff176d8920 and project 94513773e0c94187bbdaeb82c7304eae. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:17:40.316950 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-86d5db10-f98d-43fd-8d27-9b55290a0c69 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.774707 Jul 18 15:17:40.318196 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 295/577] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:17:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:40.724630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:40.725938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:40.733550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:40.734036 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:40.734888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:40.735326 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:41.482767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:41.512288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fbf72b6f-d83d-4356-9455-18d2cd672ed4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.786875 Jul 18 15:17:41.513449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 283/578] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:40 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:42.541495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:42.542161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:42.563796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:42.564925 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:42.568022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:42.571640 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:43.134690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:43.146481 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b3daa426-2954-4044-b399-83ecba9ac5ca tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.610856 Jul 18 15:17:43.148106 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 296/579] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:42 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:43.682791 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-364fbc27-fe7d-4418-95e1-0a7940a811da req-983c1220-7e1a-4d76-87a2-c7d381727e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:43.705020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-364fbc27-fe7d-4418-95e1-0a7940a811da req-983c1220-7e1a-4d76-87a2-c7d381727e22 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:43.706695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-364fbc27-fe7d-4418-95e1-0a7940a811da req-983c1220-7e1a-4d76-87a2-c7d381727e22 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:43.733763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-364fbc27-fe7d-4418-95e1-0a7940a811da req-983c1220-7e1a-4d76-87a2-c7d381727e22 service nova] Creating event network-changed:235acfe0-1c77-4d1b-a14c-fd642227cae1 for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e on hv-cinder-83697 Jul 18 15:17:43.743071 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-364fbc27-fe7d-4418-95e1-0a7940a811da req-983c1220-7e1a-4d76-87a2-c7d381727e22 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066154 Jul 18 15:17:43.744192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 284/580] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:44.166458 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:44.179016 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:44.182014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:44.182818 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:44.184023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:44.184676 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:44.591770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:44.610602 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:44.648258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:44.653534 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:44.658131 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:44.662208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:44.812578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lazy-loading 'flavor' on Instance uuid ea90bbda-13c2-40f9-bd93-daa1e79f27dd {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:17:44.863206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:44.882329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fd62510b-78ef-42a9-a8fe-927820864ca3 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.721313 Jul 18 15:17:44.898984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 297/581] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:44 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:45.419333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0aa00005-c881-49a9-928a-acc82b39ba9a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/action" status: 200 len: 32 microversion: 2.1 time: 0.851227 Jul 18 15:17:45.441466 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 285/582] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:17:44 2022] POST /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/action => generated 32 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 15:17:45.460995 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:45.462473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:45.488709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:45.489770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:45.492226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:45.493986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:45.933143 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:45.936285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:45.971376 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:45.975838 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:45.991780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:45.993104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:46.361210 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:46.374330 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0f606026-0f97-424e-8832-d3141c1b2de6 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.455716 Jul 18 15:17:46.387641 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 286/583] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:45 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:46.516932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:46.546355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-65cb46d4-7447-4834-b762-7d7071679877 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 1.099168 Jul 18 15:17:46.548432 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 298/584] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:45 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:47.394257 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:47.394904 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:47.397911 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=76 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:47.403129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:47.403591 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:47.404367 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:47.404809 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:47.571912 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:47.573148 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:47.574379 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:47.579921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:47.580447 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:47.581301 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:47.581815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:47.582956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bd240ede-f08a-42d5-adfe-7ac69e6a7990 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.192644 Jul 18 15:17:47.595175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 287/585] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:47 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:47.768175 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:47.778876 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-276e7a3e-be3d-4a71-9d6f-2aa1d08c078a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.213305 Jul 18 15:17:47.798792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 299/586] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:47 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:48.604211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:48.606298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:48.623774 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:48.625205 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:48.626767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:48.628119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:48.808130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:48.810286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:48.818005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:48.834018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:48.836298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:48.839593 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:48.841161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:48.844277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3dd79324-89f2-444a-b4ad-b42430b66d98 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.245531 Jul 18 15:17:48.845937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 288/587] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:48 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:49.086092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:49.097714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1d19a209-eeae-4693-a10c-3536ca86ab06 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.295603 Jul 18 15:17:49.108709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 300/588] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:48 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:49.211284 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-93d6c80d-3409-4e92-adcb-106503135f75 req-0d218d93-95bc-453d-b982-a15112d49404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e", "name": "network-vif-plugged", "status": "completed", "tag": "7378b582-67ac-41b6-ac1b-cfbd2f8feedd"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:17:49.250268 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-93d6c80d-3409-4e92-adcb-106503135f75 req-0d218d93-95bc-453d-b982-a15112d49404 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:49.251076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-93d6c80d-3409-4e92-adcb-106503135f75 req-0d218d93-95bc-453d-b982-a15112d49404 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:49.274729 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-93d6c80d-3409-4e92-adcb-106503135f75 req-0d218d93-95bc-453d-b982-a15112d49404 service nova] Creating event network-vif-plugged:7378b582-67ac-41b6-ac1b-cfbd2f8feedd for instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e on hv-cinder-83697 Jul 18 15:17:49.292805 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-93d6c80d-3409-4e92-adcb-106503135f75 req-0d218d93-95bc-453d-b982-a15112d49404 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085772 Jul 18 15:17:49.293901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 289/589] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:17:49.866584 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:49.867705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:49.877034 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:49.877485 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:49.878777 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:49.879230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:50.073171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:50.083355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bb0b99ea-a9de-41ea-a717-1452a47f3254 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.221163 Jul 18 15:17:50.084895 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 301/590] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:49 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:50.120371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:50.121457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:50.131018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:50.133781 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:50.133781 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:50.133781 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:50.322276 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:50.336722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-770e532c-62d8-4857-ac3f-590a88740e17 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.224661 Jul 18 15:17:50.337498 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 290/591] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:50 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:51.103029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:51.103757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:51.105833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:51.111736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:51.112186 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:51.112980 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:51.113424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:51.277412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:51.286206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9e6e8711-7df9-4753-8e74-14c0e704661a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1319 microversion: 2.1 time: 0.188653 Jul 18 15:17:51.286868 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 302/592] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:51 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:51.361052 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:51.363093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:51.376462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:51.377476 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:51.378615 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:51.379118 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:51.583431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:51.593056 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a03850d2-0cbd-47cb-80a2-93a94fcaae87 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.238863 Jul 18 15:17:51.594061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 291/593] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:51 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:52.305997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:52.306957 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:52.313867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:52.314315 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:52.315711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:52.315711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:52.508441 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:52.520593 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-84e544ae-4b02-4aa4-86a2-db1d9e099054 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1507 microversion: 2.1 time: 0.219161 Jul 18 15:17:52.521652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 303/594] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:52 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:52.613054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:52.614003 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:52.627475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:52.628881 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:52.630505 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:52.632195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:52.841073 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:52.851701 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c48513e3-1013-4bf2-9ddd-e29b910c12ff tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.243956 Jul 18 15:17:52.852617 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 292/595] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:52 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:53.874271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:53.875235 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:53.886386 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:53.886996 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:53.888319 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:53.888945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:54.063431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:54.076483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-65ebabdb-9741-409a-87e0-dab0e9fc6f8d tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.211323 Jul 18 15:17:54.077748 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 304/596] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:53 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:55.101195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:55.102020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:55.114239 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:55.115219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:55.116667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:55.117811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:55.324279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:55.338878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-03d40dc0-bc19-4299-b2c1-2d9eda044f7f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.245532 Jul 18 15:17:55.339878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 293/597] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:55 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:56.361105 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:56.362104 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:56.376743 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:56.377518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:56.378463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:56.379017 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:56.591942 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:56.605137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-89eea437-4e32-4aa8-a956-e6207d111e7e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.250660 Jul 18 15:17:56.605969 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 305/598] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:56 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:17:57.627028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:57.627619 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:57.635336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:57.636090 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:57.637808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:57.638280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:57.661387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:17:57.821603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:57.837747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e701c112-cac7-479a-8cf9-3d64b86a6e97 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.214785 Jul 18 15:17:57.838428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 294/599] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:57 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:17:58.857536 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:17:58.858154 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:17:58.864869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:58.865320 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:58.866925 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:17:58.867540 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:17:59.028801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:17:59.038786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6973e179-2c30-4536-9e3f-c60ad293ce5e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.184277 Jul 18 15:17:59.039362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 306/600] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:17:58 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:00.059015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:00.059827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:00.067265 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:00.067719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:00.068512 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:00.069569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:00.221049 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:00.230337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-66e422dc-ba4a-4d44-becf-cd1cc1c91a78 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.175897 Jul 18 15:18:00.230966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 295/601] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:00 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:01.248198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:01.248882 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:01.251464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:01.257464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:01.257945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:01.258882 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:01.259331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:01.404809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:01.414414 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-288be107-d72d-483f-bb68-afcd9040a13a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.170146 Jul 18 15:18:01.430703 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 307/602] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:01 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:02.433690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:02.434309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:02.441219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:02.441737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:02.442511 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:02.442977 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:02.603079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:02.611581 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-61f14054-e817-4bcd-8e8c-06e326964b00 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.183022 Jul 18 15:18:02.612186 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 296/603] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:02 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:03.631952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:03.632689 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:03.639737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:03.640194 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:03.641009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:03.641452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:03.646012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:03.797198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:03.807212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-06fff2ea-a28e-49a3-83d2-329647a27125 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.179699 Jul 18 15:18:03.807827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 308/604] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:03 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:04.826307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:04.826885 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:04.833774 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:04.836046 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:04.836046 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:04.836295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:05.004965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:05.014012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-79939a6e-b0c7-42e9-b617-0b989e9186f3 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.191693 Jul 18 15:18:05.014623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 297/605] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:04 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:06.035667 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:06.036359 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:06.045466 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:06.045922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:06.046822 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:06.047263 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:06.197567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:06.205908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-211a540e-9ada-4e23-ac71-40dfb5b8af35 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.174604 Jul 18 15:18:06.206509 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 309/606] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:06 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:07.226601 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:07.227173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:07.234583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:07.235127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:07.236920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:07.236920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:07.417397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:07.427343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8e8a0490-23d0-4c0d-a11f-0042f9296e2c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.205662 Jul 18 15:18:07.427991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 298/607] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:07 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:08.445711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:08.446362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:08.453254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:08.453736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:08.454522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:08.455205 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:08.608157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:08.617607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4e742bd1-8c8e-44b8-9584-5390cf344305 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.176184 Jul 18 15:18:08.620207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 310/608] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:08 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:09.636442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:09.637127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:09.644459 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:09.644970 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:09.645816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:09.646301 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:09.794702 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:09.803434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ca99a866-ea19-4cf2-87c0-d07406a856d1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.171066 Jul 18 15:18:09.804148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 299/609] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:09 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:10.821977 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:10.822904 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:10.830038 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:10.830521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:10.831347 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:10.831786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:10.985238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:10.994576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-496da317-381a-46d0-a721-cc55e462e8f0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.176780 Jul 18 15:18:10.995192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 311/610] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:10 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:12.014830 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:12.015450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:12.023022 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:12.023491 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:12.024294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:12.024813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:12.181568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:12.187711 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6f998f9c-e974-407b-8d9c-19e41fb4ecec tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.176773 Jul 18 15:18:12.188306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 300/611] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:12 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:13.205931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:13.206563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:13.221897 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.222349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.223178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.223658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.380780 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:13.387727 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:13.388710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:13.390131 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c4b2329e-1b4f-4276-b224-6839415fe406 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.188088 Jul 18 15:18:13.391431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 312/612] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:13 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:13.407318 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.407886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.408752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.409241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.441123 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c1926d41-0d18-422a-86ce-dfa7e927a9ab tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments/24a592d5-f73d-4f7a-9e46-12da72b5dc97" status: 200 len: 194 microversion: 2.20 time: 0.058245 Jul 18 15:18:13.441716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 301/613] 10.222.0.83 () {60 vars in 1453 bytes} [Mon Jul 18 15:18:13 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments/24a592d5-f73d-4f7a-9e46-12da72b5dc97 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 15:18:13.511854 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:13.512357 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:13.518564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.519025 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.519802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.520246 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.658922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lazy-loading 'services' on Instance uuid 2e422edc-5603-4ed9-8572-d40f50f25155 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:13.952709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-57e57612-faef-4ddb-8200-aaa7a7ad8e17 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments/24a592d5-f73d-4f7a-9e46-12da72b5dc97" status: 202 len: 0 microversion: 2.20 time: 0.444695 Jul 18 15:18:13.953374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 313/614] 10.222.0.83 () {60 vars in 1456 bytes} [Mon Jul 18 15:18:13 2022] DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments/24a592d5-f73d-4f7a-9e46-12da72b5dc97 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:18:13.967747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:13.969492 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:13.977142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.977608 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:13.978516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:13.978929 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:14.012362 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2e5c2c8b-79ab-4488-ac35-368ed07126a8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052868 Jul 18 15:18:14.013154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 302/615] 10.222.0.83 () {60 vars in 1342 bytes} [Mon Jul 18 15:18:13 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:18:14.413997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:14.414838 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:14.425327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:14.426212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:14.426784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:14.427034 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:14.590020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:14.599040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6b908b82-67ec-46ab-832f-77d93ec2bafb tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1736 microversion: 2.1 time: 0.190902 Jul 18 15:18:14.599740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 314/616] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:14 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:15.033410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:15.034340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:15.041902 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:15.042394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:15.043410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:15.043863 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:15.078981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d2c8cc06-df20-4515-871d-ddc80db5e919 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052060 Jul 18 15:18:15.079572 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 303/617] 10.222.0.83 () {60 vars in 1342 bytes} [Mon Jul 18 15:18:15 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:18:15.617873 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:15.618565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:15.626688 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:15.627150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:15.627958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:15.628526 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:15.818059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:15.833007 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5f94934e-70ca-47d4-9c1a-43a4d5dd6133 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1716 microversion: 2.1 time: 0.218019 Jul 18 15:18:15.833007 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 315/618] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:15 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1716 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:15.953145 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:15.954024 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:15.961680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:15.964675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:15.964675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:15.964675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.059325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] HTTP exception thrown: Cannot 'detach_volume' instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd while it is in vm_state rescued Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Request method failure captured: Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments/f12db057-e3fd-4dab-b040-3cbd56cbacbf HTTP/1.1 Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XilQOYHXnhdj8LVhm7yZ74HO2Lcn7vbfHWa-RSIfxRpuNTHr6-zMoophvAWGrAJjebPvYyHYWva1LAM5w9F1HEcJaB67vDQDlBjZEG_w9tq_Qi3149rOCGtxWQp4jBQHRz5XSFm1jGrr9iWAPcw-e-hec50dMNiV7D_ksgh51StYiE Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:18:16.060966 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0e83fff7c7524da9905cdb86ccdb565a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 648c869550ee437a8e775e997c741e58 Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:18:16.062558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Cannot 'detach_volume' instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd while it is in vm_state rescued Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'server_id': 'ea90bbda-13c2-40f9-bd93-daa1e79f27dd', 'id': 'f12db057-e3fd-4dab-b040-3cbd56cbacbf'} Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:18:16.069164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd while it is in vm_state rescued Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd while it is in vm_state rescued Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:16.071021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Returning 409 to user: Cannot 'detach_volume' instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd while it is in vm_state rescued {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:18:16.072208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-de175084-2268-4db2-ac0b-0670d24a349b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments/f12db057-e3fd-4dab-b040-3cbd56cbacbf" status: 409 len: 152 microversion: 2.1 time: 0.113382 Jul 18 15:18:16.072208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 304/619] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:18:15 2022] DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments/f12db057-e3fd-4dab-b040-3cbd56cbacbf => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 15:18:16.078357 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:16.079230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:16.091381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:16.096710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:16.096923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.096923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:16.096923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.097173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:16.103826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:16.104351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.105058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:16.105499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.150855 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0bda01ab-0afa-44cd-ae82-32e55d5b437f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063034 Jul 18 15:18:16.151450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 305/620] 10.222.0.83 () {60 vars in 1342 bytes} [Mon Jul 18 15:18:16 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:18:16.350819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dbb5fe02-6961-4bd4-8954-9c3fbfc6c968 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "POST /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/action" status: 202 len: 0 microversion: 2.1 time: 0.279789 Jul 18 15:18:16.356067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 316/621] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:18:16 2022] POST /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:18:16.371582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:16.372216 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:16.388758 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:16.389258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.390126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:16.390797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:16.544924 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-71369591", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577847118", "security_groups": [{"name": "tempest-secgroup-smoke-606153650"}], "block_device_mapping_v2": [{"uuid": "f5722306-0c6b-43f9-9347-52498ce6ab11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dccabfdf-5758-41b0-add6-21d121e89ad0"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:16.582190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:16.591629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-37539103-30b8-49d6-9d0b-937f2b78b9f1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1724 microversion: 2.1 time: 0.233669 Jul 18 15:18:16.592228 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 306/622] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:16 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:16.684136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] validate_networks() for [('dccabfdf-5758-41b0-add6-21d121e89ad0', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:18:17.171821 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:17.174068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:17.186322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.187441 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.190496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.190785 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.231169 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5e3c1cbb-5e98-40c3-8207-4e8c707f5886 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069159 Jul 18 15:18:17.236745 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 307/623] 10.222.0.83 () {60 vars in 1342 bytes} [Mon Jul 18 15:18:17 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:17.347062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:17.347062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:17.355113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.355553 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.356377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.357044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.388210 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:18:17.701951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c97e5f2c-acdf-48ba-9d72-691d4416ada6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 204 len: 0 microversion: 2.20 time: 0.359905 Jul 18 15:18:17.703155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 308/624] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Jul 18 15:18:17 2022] DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 15:18:17.707720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:18:17.707720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:18:17.707720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:18:17.707720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:18:17.707720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:18:17.709670 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:17.711212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:17.719946 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.720726 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.721631 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.722126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.722821 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.723190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.724671 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.726128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.744929 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for project 94513773e0c94187bbdaeb82c7304eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:18:17.749448 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for user 6bfa2a00688d4eab993059ff176d8920 and project 94513773e0c94187bbdaeb82c7304eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:18:17.764458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:17.816383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:18:17.818659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5722306-0c6b-43f9-9347-52498ce6ab11',volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:18:17.954713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:17.964968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-15f46177-990e-4e54-b2d4-9e516810e3d7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1724 microversion: 2.1 time: 0.260437 Jul 18 15:18:17.965887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 309/625] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:17 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:17.972135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:17.972650 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:17.983166 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.983166 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:17.983899 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:17.984539 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:18.179312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:18.188813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:18.190481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:18.203482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e53cfaa0-4ef8-4996-947e-0c2258f8c360 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.224641 Jul 18 15:18:18.203482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 310/626] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:17 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:18.451833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2b66918d-8b66-4ff4-8a12-2a7f0fca0570 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.916798 Jul 18 15:18:18.452411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 317/627] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:18:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:18:18.464117 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5eb2b551-e693-482b-a878-3c262c0e7a5f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:18.468903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5eb2b551-e693-482b-a878-3c262c0e7a5f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:18.524811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5eb2b551-e693-482b-a878-3c262c0e7a5f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:18.535994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5eb2b551-e693-482b-a878-3c262c0e7a5f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1092 microversion: 2.1 time: 0.076627 Jul 18 15:18:18.538414 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 311/628] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:18 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1092 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:18.984850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:18.986391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:18.994642 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:18.995109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:18.995903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:18.996390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:19.141384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:19.150157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f275c53e-00f3-47bd-b2ca-38d990dd7462 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1724 microversion: 2.1 time: 0.170041 Jul 18 15:18:19.150789 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 318/629] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:18 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:19.212353 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:19.213032 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:19.215497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:19.222212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:19.222708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:19.223510 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:19.223960 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:19.420247 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:19.432282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:19.433820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:19.435249 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-46f3fd38-1a5e-498c-96bb-9a62d0563885 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.227158 Jul 18 15:18:19.435805 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 312/630] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:19 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:19.554264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0e37c8e0-c9f3-4b8b-b31b-1953ec07d459 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:19.555155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0e37c8e0-c9f3-4b8b-b31b-1953ec07d459 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:19.629223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0e37c8e0-c9f3-4b8b-b31b-1953ec07d459 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:19.637140 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0e37c8e0-c9f3-4b8b-b31b-1953ec07d459 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1092 microversion: 2.1 time: 0.086967 Jul 18 15:18:19.638182 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 319/631] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:19 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1092 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:20.168510 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:20.169128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:20.175349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:20.175802 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:20.176586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:20.177058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:20.352637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:20.361629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-35299cdb-8f5c-419b-a571-9bbb9db9ffe1 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1724 microversion: 2.1 time: 0.197573 Jul 18 15:18:20.362377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 313/632] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:20 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:20.454849 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:20.456155 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:20.463687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:20.464695 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:20.465806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:20.466357 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:20.655888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:20.656669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:20.663359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:20.664418 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:20.665327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:20.665841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:20.679408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:20.690156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:20.691663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:20.692886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e38982ad-0c09-440c-8ce0-f25310d2bdba tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1724 microversion: 2.20 time: 0.242240 Jul 18 15:18:20.693459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 320/633] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:20 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:20.740903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:20.749408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9b42ad19-b15f-4306-b19e-fb7113d379fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1134 microversion: 2.1 time: 0.097842 Jul 18 15:18:20.750003 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 314/634] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:20 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1134 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:21.184084 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-89e50c4a-a3be-41b3-8088-8c098c7e1840 req-69260c6e-878e-4c7e-bb43-62e384464837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e422edc-5603-4ed9-8572-d40f50f25155", "name": "network-vif-deleted", "tag": "44a662c2-0032-4fe9-8811-a09c0727e6ac"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:21.192811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-89e50c4a-a3be-41b3-8088-8c098c7e1840 req-69260c6e-878e-4c7e-bb43-62e384464837 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.196036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-89e50c4a-a3be-41b3-8088-8c098c7e1840 req-69260c6e-878e-4c7e-bb43-62e384464837 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.206611 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-89e50c4a-a3be-41b3-8088-8c098c7e1840 req-69260c6e-878e-4c7e-bb43-62e384464837 service nova] Creating event network-vif-deleted:44a662c2-0032-4fe9-8811-a09c0727e6ac for instance 2e422edc-5603-4ed9-8572-d40f50f25155 on hv-cinder-83697 Jul 18 15:18:21.212687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-89e50c4a-a3be-41b3-8088-8c098c7e1840 req-69260c6e-878e-4c7e-bb43-62e384464837 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Jul 18 15:18:21.213311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 321/635] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:21.381379 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:21.381982 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:21.390702 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.391174 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.392009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.392443 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.560813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:21.580677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a5e761eb-978b-425a-8e49-0f4d58ce4cf0 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1724 microversion: 2.1 time: 0.192463 Jul 18 15:18:21.580677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 315/636] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:21 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:21.717543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:21.720894 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:21.727734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.728191 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.729011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.729440 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.767664 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:21.769088 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:21.779335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.780133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.781602 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:21.782061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:21.804086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:21.814497 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:21.816244 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:21.817441 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-29922ee8-423e-4c48-af3e-f7fae8990ed8 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1656 microversion: 2.20 time: 0.108401 Jul 18 15:18:21.818222 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 322/637] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:21 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1656 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:21.884016 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:21.893877 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-75fee36d-227e-4b23-aac5-44b4b6cface2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1134 microversion: 2.1 time: 0.130363 Jul 18 15:18:21.894832 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 316/638] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:21 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1134 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:22.597785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:22.598412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:22.607150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:22.607904 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:22.610165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:22.610165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:22.840523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:22.841956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:22.851384 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:22.852220 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:22.853360 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:22.853818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:22.911630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:22.914008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:22.915338 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lazy-loading 'fault' on Instance uuid 2e422edc-5603-4ed9-8572-d40f50f25155 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:22.975532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:22.992805 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:22.996935 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:22.999191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d50997a3-a0f9-49f3-a289-589da3546264 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 200 len: 1372 microversion: 2.20 time: 0.165516 Jul 18 15:18:23.000404 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 317/639] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:22 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:23.003819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:23.011069 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:23.012549 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:23.020438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:23.020889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:23.021471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-98ba80e1-27be-4c53-a24e-d97c80fadb03 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1724 microversion: 2.1 time: 0.427886 Jul 18 15:18:23.021675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:23.022304 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:23.022691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 323/640] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:22 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1724 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:23.099429 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:23.107939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0eba0f67-c7eb-4f8c-9d41-7359d9a7c523 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1190 microversion: 2.1 time: 0.105859 Jul 18 15:18:23.108540 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 318/641] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:23 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1190 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:24.024203 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:24.025697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:24.034736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.034736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.034736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.034736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.041280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:24.042754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:24.050680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.051462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.052274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.052718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.061262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] HTTP exception thrown: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Request method failure captured: Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 HTTP/1.1 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XiliUCmtPoHfjKcSAmAntUtKYmHXN9t9S4KxVcLYlR0olanBpUT0PSt_r205KizBwxvD8fraKSzMScPAt_CGVnrLJ29h15EO9vm2zanuiQeV_VC8V8k4DQyjJj6lgmmr-GO67-1Qs7UflC6Pi1CRflicMo0HZxWcqSpvw-faWkSAS4 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:18:24.064350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ea95f701696f4c28b2d4bbef9d0af45d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: f3f0c37e426640f9960c1da232605e55 Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:18:24.067461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '2e422edc-5603-4ed9-8572-d40f50f25155'} Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:18:24.068242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:18:24.070630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:24.071783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Returning 404 to user: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:18:24.071783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc966988-f808-4102-9fd8-7b2b0e5a5793 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 404 len: 111 microversion: 2.20 time: 0.047113 Jul 18 15:18:24.071783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 324/642] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:24 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:18:24.078693 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f729c7bc-19dd-439f-a0da-2a362cae72f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '.version_select at 0x7f48c1521e50>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:24.194413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f729c7bc-19dd-439f-a0da-2a362cae72f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049254728" status: 204 len: 0 microversion: 2.20 time: 0.120378 Jul 18 15:18:24.200135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 325/643] 10.222.0.83 () {60 vars in 1261 bytes} [Mon Jul 18 15:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049254728 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 15:18:24.207734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:24.208559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:24.216852 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.217419 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.218745 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.219433 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.275080 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:24.290802 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8996890b-82e9-4b47-9f46-20628217a208 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1730 microversion: 2.1 time: 0.254308 Jul 18 15:18:24.292151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 319/644] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:24 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:24.312116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:24.321600 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:24.324064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b143ae8e-fbf6-4de4-8b8b-2dc45d93f72f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1198 microversion: 2.1 time: 0.125973 Jul 18 15:18:24.325618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 326/645] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:24 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1198 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:24.326806 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:24.339804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.340582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.342700 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.343107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.475333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d18cd827-c4a4-4993-98a5-a29cd26bf41f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165997 Jul 18 15:18:24.475333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 320/646] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:18:24 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:18:24.740907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "645df6f7-b7fb-4761-a101-a9397d40b09b", "device": "/dev/sdb"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:24.743161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:24.750628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.753880 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.753880 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:24.753880 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:24.761740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:25.342887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:25.344689 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:25.363827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:25.363827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:25.363827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:25.363827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:25.877209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cd1eab5f-fa07-43bd-b8cc-d0940efaaf8e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "POST /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140014 Jul 18 15:18:25.884085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 327/647] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:18:24 2022] POST /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e/os-volume_attachments => generated 194 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:25.904127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ce35282-4f9b-45d2-a424-4e301361f227 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'create', calling method: .version_select at 0x7f48c146c160>, body: {"keypair": {"name": "tempest-keypair-388876693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLs3xoeM387OEkBbJiNNqMK0LP8faEmOIZ9fBmCn0k8tla9iao8yG1/+qCIjvpcFRQ/wDLdA6o5fVKvrqYBdSjZYg2kyO23cR2M4PHFGDwBImLA5TcvF/y1+NRQ8hkyCw=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:25.935641 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-9ce35282-4f9b-45d2-a424-4e301361f227 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:18:25.936704 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:25.940872 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-9ce35282-4f9b-45d2-a424-4e301361f227 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for user f3f0c37e426640f9960c1da232605e55 and project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:18:25.948040 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b737cd95-3f6b-480e-9916-7d1dd50916c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1275 microversion: 2.1 time: 0.610245 Jul 18 15:18:25.948636 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 321/648] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:25 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1275 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:26.049298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9ce35282-4f9b-45d2-a424-4e301361f227 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.160378 Jul 18 15:18:26.049298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 328/649] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Jul 18 15:18:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 15:18:26.190322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-fcbe7c69-94d7-4913-8361-1bde430f8ff1 req-4472bef6-f579-4c5c-8974-35f192901494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea90bbda-13c2-40f9-bd93-daa1e79f27dd", "tag": "e9e943a0-f833-4d66-8068-fd9533d671de"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:26.209017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-fcbe7c69-94d7-4913-8361-1bde430f8ff1 req-4472bef6-f579-4c5c-8974-35f192901494 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:26.209466 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-fcbe7c69-94d7-4913-8361-1bde430f8ff1 req-4472bef6-f579-4c5c-8974-35f192901494 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:26.250418 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-fcbe7c69-94d7-4913-8361-1bde430f8ff1 req-4472bef6-f579-4c5c-8974-35f192901494 service nova] Creating event network-changed:e9e943a0-f833-4d66-8068-fd9533d671de for instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd on hv-cinder-83697 Jul 18 15:18:26.257362 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-fcbe7c69-94d7-4913-8361-1bde430f8ff1 req-4472bef6-f579-4c5c-8974-35f192901494 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074323 Jul 18 15:18:26.258722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 322/650] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:26.966786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:26.968759 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:26.978398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:26.979216 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:26.993174 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:26.993638 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:27.315424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-6b3175a6-2422-441e-beaf-4b299b248ca0 req-d621dacb-cf7b-425c-8315-aeb9b04f8472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0a0fa7-898e-4bdd-9a61-8ed362f942be", "tag": "2d834c80-f254-424d-8f17-9e435fae87c0"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:27.329302 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-6b3175a6-2422-441e-beaf-4b299b248ca0 req-d621dacb-cf7b-425c-8315-aeb9b04f8472 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:27.330219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-6b3175a6-2422-441e-beaf-4b299b248ca0 req-d621dacb-cf7b-425c-8315-aeb9b04f8472 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:27.345240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-6b3175a6-2422-441e-beaf-4b299b248ca0 req-d621dacb-cf7b-425c-8315-aeb9b04f8472 service nova] Creating event network-changed:2d834c80-f254-424d-8f17-9e435fae87c0 for instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be on hv-cinder-83697 Jul 18 15:18:27.351407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-6b3175a6-2422-441e-beaf-4b299b248ca0 req-d621dacb-cf7b-425c-8315-aeb9b04f8472 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041613 Jul 18 15:18:27.352762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 323/651] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:18:27.360325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:27.375570 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-af25344a-3256-4c18-806f-d5c790c1162a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.411775 Jul 18 15:18:27.387070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 329/652] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:26 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:28.296960 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-f52c6839-17cd-4ebb-ae27-436fe23b5a81 req-4f72a1d0-b672-410b-a814-65e92bd5fd17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea90bbda-13c2-40f9-bd93-daa1e79f27dd", "tag": "e9e943a0-f833-4d66-8068-fd9533d671de"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:28.307631 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-f52c6839-17cd-4ebb-ae27-436fe23b5a81 req-4f72a1d0-b672-410b-a814-65e92bd5fd17 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:28.308076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-f52c6839-17cd-4ebb-ae27-436fe23b5a81 req-4f72a1d0-b672-410b-a814-65e92bd5fd17 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:28.319675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-f52c6839-17cd-4ebb-ae27-436fe23b5a81 req-4f72a1d0-b672-410b-a814-65e92bd5fd17 service nova] Creating event network-changed:e9e943a0-f833-4d66-8068-fd9533d671de for instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd on hv-cinder-83697 Jul 18 15:18:28.325562 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-f52c6839-17cd-4ebb-ae27-436fe23b5a81 req-4f72a1d0-b672-410b-a814-65e92bd5fd17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042193 Jul 18 15:18:28.326245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 324/653] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:28.396270 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:28.397825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:28.401367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:28.408836 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:28.409601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:28.410618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:28.411221 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:28.574027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:28.585204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f0f1dea8-ccd4-4cb4-91b6-22b2f71408c9 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.193069 Jul 18 15:18:28.597997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 330/654] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:28 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:29.070833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:29.077128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2131432884", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a1ac9f5-015a-4283-8dc4-629581b138ba"}], "security_groups": [{"name": "tempest-securitygroup--986528283"}], "key_name": "tempest-keypair-388876693", "user_data": "}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:29.340037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] validate_networks() for [('7a1ac9f5-015a-4283-8dc4-629581b138ba', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:18:29.603207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:29.603899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:29.610622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:29.611080 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:29.611886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:29.612325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:29.767706 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:18:29.768297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:18:29.769050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:18:29.769709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:18:29.770312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:18:29.780009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:29.783868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:29.784570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:29.785718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:29.786193 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:29.788520 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0de3b36e-7daf-426d-89cd-7a098c63fe87 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.189854 Jul 18 15:18:29.789472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 331/655] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:29 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:29.813172 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:18:29.817903 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Getting quotas for user f3f0c37e426640f9960c1da232605e55 and project ea95f701696f4c28b2d4bbef9d0af45d. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:18:29.832705 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:18:29.835295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:18:29.946455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2033587780"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:29.947997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:29.958222 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:29.959091 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:29.960742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:29.961565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:29.962033 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3d00d3b4-32cf-403a-9a53-4c530d24cb73 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.892437 Jul 18 15:18:29.963002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 325/656] 10.222.0.83 () {62 vars in 1187 bytes} [Mon Jul 18 15:18:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 15:18:29.974458 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9164ebf5-1807-43b7-8497-d0eae08a0972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:29.975202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9164ebf5-1807-43b7-8497-d0eae08a0972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:30.059486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9164ebf5-1807-43b7-8497-d0eae08a0972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:30.078199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9164ebf5-1807-43b7-8497-d0eae08a0972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:30.080669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9164ebf5-1807-43b7-8497-d0eae08a0972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:30.082280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9164ebf5-1807-43b7-8497-d0eae08a0972 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1281 microversion: 2.20 time: 0.112153 Jul 18 15:18:30.083422 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 326/657] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:29 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:30.170844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.network.security_group_api [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Removing security group d88d86b2-802a-40db-9aad-c10f341ebe26 from port b7362e28-3d73-4fdc-b428-2c67c361b97e Jul 18 15:18:30.667082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c2eb8b09-3d0b-4be1-81ff-7e509c81f579 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/action" status: 202 len: 0 microversion: 2.1 time: 0.725926 Jul 18 15:18:30.668350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 332/658] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:18:29 2022] POST /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 15:18:30.685932 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-f30183ea-4c0f-440a-adf6-99d42e04a193 req-3af831ae-9f99-4b4e-ab58-c5d95cf03d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:30.719291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-f30183ea-4c0f-440a-adf6-99d42e04a193 req-3af831ae-9f99-4b4e-ab58-c5d95cf03d31 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:30.719941 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-f30183ea-4c0f-440a-adf6-99d42e04a193 req-3af831ae-9f99-4b4e-ab58-c5d95cf03d31 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:30.733886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-f30183ea-4c0f-440a-adf6-99d42e04a193 req-3af831ae-9f99-4b4e-ab58-c5d95cf03d31 service nova] Creating event network-changed:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:18:30.740437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-f30183ea-4c0f-440a-adf6-99d42e04a193 req-3af831ae-9f99-4b4e-ab58-c5d95cf03d31 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066140 Jul 18 15:18:30.742285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 327/659] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:30.810359 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:30.811561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:30.823923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:30.832196 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:30.834106 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:30.834986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:31.101821 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:31.102772 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:31.131969 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:31.133732 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:31.135520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:31.147340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:31.157573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:31.173235 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3d12425e-6f70-4382-b536-1b2d81961cbd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.369887 Jul 18 15:18:31.173891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 333/660] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:30 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:31.273336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:31.290485 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:31.294168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:31.297050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f9b90933-0b93-45ca-b67c-aa9931dbfb2a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1285 microversion: 2.20 time: 0.198974 Jul 18 15:18:31.302450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 328/661] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:31 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:32.191535 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:32.192200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:32.194674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:32.200575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.201057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.201932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.202301 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.320095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:32.322132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:32.331764 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.332577 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.333921 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.334919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.390972 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:32.400825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-09f676da-4e0a-4a6c-a244-bed01b00b9ae tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.213363 Jul 18 15:18:32.403964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 334/662] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:32 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:32.420797 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:32.421648 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:32.428459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.428909 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.429878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.430717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.454616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:32.485199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:32.487297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:32.491815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-23d5fe22-0096-4925-911b-db495c769b2e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1333 microversion: 2.20 time: 0.172959 Jul 18 15:18:32.491815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 329/663] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:32 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:32.494999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-77b6bd5c-5ea4-45ad-b185-d607903f28c7 req-da6a35f1-648b-4bac-8d41-3765c3ce4cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:32.505786 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-77b6bd5c-5ea4-45ad-b185-d607903f28c7 req-da6a35f1-648b-4bac-8d41-3765c3ce4cbd service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.506510 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-77b6bd5c-5ea4-45ad-b185-d607903f28c7 req-da6a35f1-648b-4bac-8d41-3765c3ce4cbd service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.528033 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-77b6bd5c-5ea4-45ad-b185-d607903f28c7 req-da6a35f1-648b-4bac-8d41-3765c3ce4cbd service nova] Creating event network-changed:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:18:32.536217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-77b6bd5c-5ea4-45ad-b185-d607903f28c7 req-da6a35f1-648b-4bac-8d41-3765c3ce4cbd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045578 Jul 18 15:18:32.537190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 330/664] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:32.543050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lazy-loading 'services' on Instance uuid b701eaa8-49d9-4517-861d-df2653859765 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:32.811262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-59dc3459-851b-479d-b93f-698377f43fec tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments/265b8e35-7ae0-45c3-b3d8-6a5e6a320653" status: 202 len: 0 microversion: 2.1 time: 0.405537 Jul 18 15:18:32.812018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 335/665] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:18:32 2022] DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments/265b8e35-7ae0-45c3-b3d8-6a5e6a320653 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:18:32.827053 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:32.828303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:32.836515 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.837160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.838119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:32.838945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:32.895484 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5d7c006b-7cfc-470f-a8c4-b9473329d357 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075698 Jul 18 15:18:32.896388 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 331/666] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:32 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:33.430481 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:33.431875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:33.454300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:33.454792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:33.455616 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:33.456081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:33.514939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:33.516842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:33.529613 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:33.531059 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:33.536455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:33.537377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:33.546774 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:33.645703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:33.662600 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:33.667286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:33.670065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3425b45e-e212-4e3f-af60-b97f1206a3c2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1339 microversion: 2.20 time: 0.159415 Jul 18 15:18:33.671523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 332/667] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:33 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:33.765707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:33.775027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7e2865d1-64c3-4e51-8e3d-c8a540a3fbd1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.353308 Jul 18 15:18:33.775617 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 336/668] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:33 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:33.910869 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:33.911958 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:33.920083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:33.920540 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:33.921351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:33.922091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:33.957850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b18a118b-936d-4304-a989-b6cdeab3e1aa tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051614 Jul 18 15:18:33.964229 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 333/669] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:33 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:34.690612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:34.691274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:34.698673 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.699153 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.699972 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.700526 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.775036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:34.784082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:34.786583 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:34.788194 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0f478529-4400-4949-afe1-dba8b668d1e5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1339 microversion: 2.20 time: 0.102334 Jul 18 15:18:34.790580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 337/670] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:34 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:34.806777 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:34.808793 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:34.817326 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.818474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.819657 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.820638 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.872599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:34.873759 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:34.881137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.888589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.888589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.888589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.939331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b5ddc4d3-6cd3-4b64-ae61-bfaf274b3c8f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072705 Jul 18 15:18:34.940589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 338/671] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:34 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 15:18:34.974603 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:34.975631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:34.983508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.984648 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:34.985657 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:34.986282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.034425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c218dfd5-f964-4180-873e-43883a26a209 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064407 Jul 18 15:18:35.035976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 339/672] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:34 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:18:35.042321 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:35.049437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:35.050284 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:35.050796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.051600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:35.052045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.056455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:35.064633 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-237c8743-6ae5-4840-863a-159a1aa3c190 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.264029 Jul 18 15:18:35.065230 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 334/673] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:34 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:35.081908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:18:35.488733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d708636a-4f8b-479b-9bbb-dce0eff09915 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 204 len: 0 microversion: 2.1 time: 0.451069 Jul 18 15:18:35.489694 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 340/674] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:18:35 2022] DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:18:35.501316 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:35.503615 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:35.512968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:35.514021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.515210 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:35.515763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.692050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:35.700196 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cedcac8e-14f5-4ee4-bc3a-7969d78c3689 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1669 microversion: 2.1 time: 0.203958 Jul 18 15:18:35.700794 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 335/675] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:35 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:35.812299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:35.813059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:35.819850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:35.820291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.821087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:35.821602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:35.841340 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:35.953329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=12 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:36.048611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:36.050214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:36.057688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.058143 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.058985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.059416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.101039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:36.108207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-87cc445a-9b4b-4605-9c6f-36fbd125abe2 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063874 Jul 18 15:18:36.113061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 336/676] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:36 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:36.115751 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:36.116507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:36.118256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:36.120846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:36.123992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.124939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.126081 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.126789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.132772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4635eadb-a234-45d9-98c0-238738457768 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.317119 Jul 18 15:18:36.142068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 341/677] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:35 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:36.296466 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:36.305555 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b95e72fa-7df5-4ce0-9fe7-1f33e7f488c6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.193856 Jul 18 15:18:36.306147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 337/678] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:36 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:36.463425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-9cfb0440-09e4-4790-bdcc-1ba2d0cb924e req-77dfe624-64c2-498f-ae61-1a5c461cf04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:36.473871 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-9cfb0440-09e4-4790-bdcc-1ba2d0cb924e req-77dfe624-64c2-498f-ae61-1a5c461cf04c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.473871 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-9cfb0440-09e4-4790-bdcc-1ba2d0cb924e req-77dfe624-64c2-498f-ae61-1a5c461cf04c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.486601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-9cfb0440-09e4-4790-bdcc-1ba2d0cb924e req-77dfe624-64c2-498f-ae61-1a5c461cf04c service nova] Creating event network-changed:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:18:36.493721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-9cfb0440-09e4-4790-bdcc-1ba2d0cb924e req-77dfe624-64c2-498f-ae61-1a5c461cf04c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039925 Jul 18 15:18:36.495049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 342/679] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:36.717983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:36.718889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:36.729475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.730209 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.731657 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:36.732174 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:36.920677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:36.930392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-97f9d731-7099-4ee3-a145-dee2fa6b334f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1669 microversion: 2.1 time: 0.214863 Jul 18 15:18:36.930944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 338/680] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:36 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:37.122103 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:37.123185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:37.129907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:37.130360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:37.131187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:37.131631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:37.159313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:37.159973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:37.163920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fb3e435b-b006-40d8-9416-d3ebfbd61535 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047179 Jul 18 15:18:37.164514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 343/681] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:37 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:37.166931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:37.167389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:37.168224 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:37.168609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:37.310574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:37.319479 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:37.322522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:37.323553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:37.324263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-31c936e5-abd2-4ff0-96ad-2665f8bc791a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.168586 Jul 18 15:18:37.325680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:37.325815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 339/682] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:37 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:37.331572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:37.331572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:37.331971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:37.332427 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:37.479538 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:37.489561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f2364bdc-b353-4a9a-a1c1-029b30421e47 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.171119 Jul 18 15:18:37.490145 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 344/683] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:37 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:38.080900 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:38.081573 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:38.088943 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.089411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.090221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.090699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.177152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:38.178009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:38.186149 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.186502 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.187329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.187809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.225274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-131825f4-cb6a-4bfb-a8f6-93b8a8387321 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053066 Jul 18 15:18:38.229595 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 345/684] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:38 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:38.259332 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:38.267892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7b8b2072-7366-4767-9acc-83c571e06a85 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1669 microversion: 2.1 time: 0.323440 Jul 18 15:18:38.268498 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 340/685] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:37 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1669 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:38.346146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:38.346816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:38.354073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.354525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.355404 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.355842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.502015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:18:38.502015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:18:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:18:38.502377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:38.510957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:38.513428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:38.524444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:38.527717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:38.530437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.531612 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.531859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c005e7b5-df14-41e1-8872-763a44d1c66e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.187951 Jul 18 15:18:38.533005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 346/686] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:38 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:38.533878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:38.534995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:38.711311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:38.723885 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e5861f64-7093-453b-b879-99e534e9cae4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.219546 Jul 18 15:18:38.724952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 341/687] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:38 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:39.238314 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:39.239553 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:39.247399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.247860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.248659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.249101 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.287080 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a2c428e7-6e88-49f7-84a2-a4509cce10fc tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053058 Jul 18 15:18:39.289107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:39.290480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:39.302113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 347/688] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:18:39 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:18:39.310422 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.314720 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.314720 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.314720 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.315061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:39.315061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:39.323998 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.325469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.325719 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.326299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.455728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] HTTP exception thrown: Instance b701eaa8-49d9-4517-861d-df2653859765 is not attached to volume 265b8e35-7ae0-45c3-b3d8-6a5e6a320653 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Request method failure captured: Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments/265b8e35-7ae0-45c3-b3d8-6a5e6a320653 HTTP/1.1 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xj4dBV-I08LLOjiphIz9foAWiKPjR35M8uNOk0gh5Z4dUU6ZpHdJRPsSu3vnJ0lyPBTV3mORRQy2dLDYNqxjbOLSRAeebCOKoQnwMPCXWbM05KacHZq1JC25CM19967cnQaXxtQ9g4INwW4DMk4jFOHBvLe1Ffo5kv9na_itzG5p2Q Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: eb8e493ee52b4c2686d5010eed312191 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestMinimumBasicScenario-840208564 Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:18:39.463282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb8e493ee52b4c2686d5010eed312191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb8e493ee52b4c2686d5010eed312191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb8e493ee52b4c2686d5010eed312191", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb8e493ee52b4c2686d5010eed312191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestMinimumBasicScenario-840208564 Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: eb8e493ee52b4c2686d5010eed312191 Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestMinimumBasicScenario-840208564 Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-TestMinimumBasicScenario-840208564-project Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 45b1df340f8a4102adf5f680d7e64139 Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestMinimumBasicScenario-840208564-project Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:18:39.464999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance b701eaa8-49d9-4517-861d-df2653859765 is not attached to volume 265b8e35-7ae0-45c3-b3d8-6a5e6a320653 Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'server_id': 'b701eaa8-49d9-4517-861d-df2653859765', 'id': '265b8e35-7ae0-45c3-b3d8-6a5e6a320653'} Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 265b8e35-7ae0-45c3-b3d8-6a5e6a320653. Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:18:39.465760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b701eaa8-49d9-4517-861d-df2653859765 is not attached to volume 265b8e35-7ae0-45c3-b3d8-6a5e6a320653 Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b701eaa8-49d9-4517-861d-df2653859765 is not attached to volume 265b8e35-7ae0-45c3-b3d8-6a5e6a320653 Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:39.467035 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Returning 404 to user: Instance b701eaa8-49d9-4517-861d-df2653859765 is not attached to volume 265b8e35-7ae0-45c3-b3d8-6a5e6a320653 {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:18:39.468019 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7c01b6d3-69f4-44fa-bbc9-47ba6f6c2e15 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments/265b8e35-7ae0-45c3-b3d8-6a5e6a320653" status: 404 len: 154 microversion: 2.1 time: 0.156601 Jul 18 15:18:39.468019 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 348/689] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:18:39 2022] DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765/os-volume_attachments/265b8e35-7ae0-45c3-b3d8-6a5e6a320653 => generated 154 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:18:39.510883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:39.520623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8751dc52-4066-4c41-a4b0-06a9f14bda6c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1669 microversion: 2.1 time: 0.236943 Jul 18 15:18:39.521246 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 342/690] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:39 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1669 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:39.562305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:39.564110 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:39.574443 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.574937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.575784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.576227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.745426 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:39.746430 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:39.759386 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.759848 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.761538 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:39.761995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:39.796744 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:39.970395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:39.983155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-626155ae-7d45-4a8f-8602-2c865e84e92f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.242017 Jul 18 15:18:39.984597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 343/691] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:39 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:40.064033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:40.080565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:40.088623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:40.092351 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54a3e9c5-8d86-433f-a918-ad8a8d16fc47 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.532669 Jul 18 15:18:40.093542 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 349/692] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:39 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:40.115053 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-0d38839c-c446-4c9c-a07f-5ba5c078ce0e req-efd72af2-c836-418c-bcd6-ba48d0010f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a0fa7-898e-4bdd-9a61-8ed362f942be", "name": "network-vif-plugged", "status": "completed", "tag": "2d834c80-f254-424d-8f17-9e435fae87c0"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:40.121851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=8 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:40.129922 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-0d38839c-c446-4c9c-a07f-5ba5c078ce0e req-efd72af2-c836-418c-bcd6-ba48d0010f17 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:40.131187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-0d38839c-c446-4c9c-a07f-5ba5c078ce0e req-efd72af2-c836-418c-bcd6-ba48d0010f17 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:40.157763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-0d38839c-c446-4c9c-a07f-5ba5c078ce0e req-efd72af2-c836-418c-bcd6-ba48d0010f17 service nova] Creating event network-vif-plugged:2d834c80-f254-424d-8f17-9e435fae87c0 for instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be on hv-cinder-83697 Jul 18 15:18:40.166093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-0d38839c-c446-4c9c-a07f-5ba5c078ce0e req-efd72af2-c836-418c-bcd6-ba48d0010f17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055461 Jul 18 15:18:40.167468 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 344/693] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:40.550142 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:40.550840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:40.558243 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:40.558741 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:40.559547 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:40.559992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:40.805303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:40.824491 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:40.825576 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:40.834435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a43ab0ea-2f56-40e7-a4b7-5e08c7249ab0 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1669 microversion: 2.1 time: 0.289778 Jul 18 15:18:40.835082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 350/694] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:40 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:40.844773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:40.846031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:40.847617 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:40.848437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:40.902894 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:18:41.005626 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:41.006254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:41.013719 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.020159 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.020159 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.020159 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.331372 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1a786b10-7513-4e28-9085-977fe9dae8f4 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 204 len: 0 microversion: 2.1 time: 0.512684 Jul 18 15:18:41.332281 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 345/695] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:18:40 2022] DELETE /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 15:18:41.340909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:41.341661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:41.349749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.350614 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.351597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.352532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.538850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:41.551068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:41.554247 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:41.554247 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9ce525f8-bb31-4163-b6bc-4cf7108fe4ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.219919 Jul 18 15:18:41.554983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 346/696] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:41 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:41.566878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-23dd6721-5fe9-4949-8759-1618d6bbe02b req-483f764f-5a22-4093-abc8-a46c1d059bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f39d887-9b8a-4bda-9ddc-83c684c699f5", "name": "network-vif-deleted", "tag": "b958f53b-b3e4-4125-a02d-1bbd7c2611fe"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:41.571628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-23dd6721-5fe9-4949-8759-1618d6bbe02b req-483f764f-5a22-4093-abc8-a46c1d059bb7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.572175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-23dd6721-5fe9-4949-8759-1618d6bbe02b req-483f764f-5a22-4093-abc8-a46c1d059bb7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.586831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-23dd6721-5fe9-4949-8759-1618d6bbe02b req-483f764f-5a22-4093-abc8-a46c1d059bb7 service nova] Creating event network-vif-deleted:b958f53b-b3e4-4125-a02d-1bbd7c2611fe for instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 on hv-cinder-83697 Jul 18 15:18:41.593347 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-23dd6721-5fe9-4949-8759-1618d6bbe02b req-483f764f-5a22-4093-abc8-a46c1d059bb7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036630 Jul 18 15:18:41.594227 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 347/697] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:41.599687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:41.600904 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:41.601635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:41.608713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.609534 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.610360 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.610844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.616495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dae58a0e-47c3-4660-b0b2-461e06ba00de tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.610374 Jul 18 15:18:41.616495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 351/698] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:41 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:41.631311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:41.797540 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:41.806759 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1890a0c9-b59c-4ae9-8c7f-93055c4a58b9 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.210864 Jul 18 15:18:41.807364 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 348/699] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:41 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:41.853525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:41.854193 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:41.861085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.861572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.862334 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:41.862807 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:41.950063 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:41.959061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5e3db5df-0ed7-4a74-9204-6b0edfadd02d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1603 microversion: 2.1 time: 0.110010 Jul 18 15:18:41.960059 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 352/700] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:41 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1603 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:42.638327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:42.639076 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:42.646183 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.646824 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.647449 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.648030 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.649461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:42.650653 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:42.653578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:42.661645 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.662428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.664274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.665057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.801372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:42.816121 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-369bb4af-c7dc-457f-9cca-5233044f8ab6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.183553 Jul 18 15:18:42.817207 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 353/701] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:42 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:42.831503 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:42.833152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:42.842183 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.842817 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.848465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:42.848678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.848678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.854370 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:42.855997 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:42.857189 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f84a342c-04d6-4f6b-bc29-f3c84cdb9a78 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.279586 Jul 18 15:18:42.857967 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 349/702] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:42 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:42.978786 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:42.979427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:42.985776 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.986701 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:42.987055 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:42.987504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:43.003479 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:43.012096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-adc15382-4738-49c7-b76a-a17571c4a48c tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.188275 Jul 18 15:18:43.013003 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 354/703] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:42 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:43.059162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:43.067522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-440de56f-ed18-499b-8f87-5e0f49c361df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1603 microversion: 2.1 time: 0.093931 Jul 18 15:18:43.068125 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 350/704] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:42 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1603 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:43.844492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:43.845153 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:43.852205 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:43.852665 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:43.853463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:43.853907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:43.877394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:43.877955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:43.884841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:43.885300 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:43.886084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:43.886529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:44.026366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:44.035283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-31037551-eca6-4187-8938-7b6b0354b6cb tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.194982 Jul 18 15:18:44.035998 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 355/705] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:43 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:44.041871 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:44.042496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:44.047878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:44.056545 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:44.057008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:44.057813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:44.058256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:44.058844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:44.060457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:44.061659 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-48129c08-6e8d-4466-ba70-592bfc6c7d8c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.189055 Jul 18 15:18:44.062237 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 351/706] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:43 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:44.086011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:44.086011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:44.094130 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:44.095778 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:44.095778 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:44.096117 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:44.174397 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:44.185182 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8a97114e-ae0d-4b15-a2d4-32a0af6ec904 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1603 microversion: 2.1 time: 0.103607 Jul 18 15:18:44.185697 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 352/707] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:44 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1603 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:44.230474 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:44.238859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cd786e21-0c42-4461-aaba-bec48e36cdfe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.201776 Jul 18 15:18:44.239472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 356/708] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:44 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:45.056765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:45.057487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:45.064465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.064947 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.065780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.066219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.085576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:45.086739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:45.095439 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.096040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.097042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.097647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.224617 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:45.234028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8160f184-0a93-456b-bb57-bb45019b6366 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.181989 Jul 18 15:18:45.234906 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 353/709] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:45 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:45.250048 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:45.252516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:45.259068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.259720 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.260555 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.260999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.267587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:45.283021 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:45.285778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:45.288015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ff156c50-4bb9-4fac-8c1a-b8a9033a5c7b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.209532 Jul 18 15:18:45.289721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 357/710] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:45 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:45.298021 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:45.298672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:45.307512 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.308037 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.309079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:45.309661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:45.340867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:45.349283 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-273e5f12-4620-4a51-9b54-ebad615118ce tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1319 microversion: 2.1 time: 0.113548 Jul 18 15:18:45.349873 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 354/711] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:45 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:45.462293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:45.466271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:45.474060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d1ef2822-0b34-4d31-b288-eef0f6a0d741 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.182724 Jul 18 15:18:45.474711 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 358/712] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:45 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:46.255115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:46.255770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:46.269164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.269849 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.271125 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.271804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.310932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:46.311564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:46.319235 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.320353 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.321734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.322493 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.436545 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:46.446147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5dda006b-9ce6-4749-b53a-77287fba4f0b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.195385 Jul 18 15:18:46.446828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 355/713] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:46 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:46.451695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:46.452423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:46.461181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.461650 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.462450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.463032 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.475451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:46.489765 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:46.491957 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:46.493563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bb90a650-7b3a-4731-adc9-e14de995ad01 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.189687 Jul 18 15:18:46.494171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 359/714] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:46 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:46.498922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:46.499544 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:46.506261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.507971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.508797 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:46.509272 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:46.544702 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:46.552669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-196b2761-18ff-4ce7-aebe-4e4f196b06a9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1319 microversion: 2.1 time: 0.104737 Jul 18 15:18:46.553328 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 356/715] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:46 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:46.658507 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:46.667151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5ecb071d-2b90-4c20-b169-4038b63e4a1b tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.171909 Jul 18 15:18:46.672126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 360/716] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:46 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:47.472918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:47.473482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:47.480646 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.481114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.481948 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.482393 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.514676 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:47.515964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:47.524462 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.524963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.525806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.526429 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.651113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:47.659530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e7313df5-8d1f-48fc-9d42-6abc2404ab14 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.190850 Jul 18 15:18:47.660126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 357/717] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:47 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:47.664897 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:47.665517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:47.671716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.672542 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.672973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.673418 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.686930 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:47.696140 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:47.697684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:47.698976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e1c87c2c-efcd-4891-9c11-819cd8de9fc2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.188267 Jul 18 15:18:47.699601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 361/718] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:47 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:47.704497 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:47.705126 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:47.714129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.714616 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.715563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:47.715868 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:47.743288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:47.751199 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-33d77281-cad9-4430-bd58-429bebe40e98 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1319 microversion: 2.1 time: 0.090023 Jul 18 15:18:47.751792 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 358/719] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:47 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:47.858361 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:47.867547 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-812a87d0-b1b7-4ef4-856b-b5e6819f969d tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.166237 Jul 18 15:18:47.868242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 362/720] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:47 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:48.681096 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:48.682023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:48.692051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.692827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.694239 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.696017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.721596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:48.723808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:48.735984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.736811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.738283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.739128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.916616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:48.946075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3f17ca60-0831-4df3-afa8-de03703448b3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1263 microversion: 2.1 time: 0.257703 Jul 18 15:18:48.946075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 359/721] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:48 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1263 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:48.946075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:48.946075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:48.949655 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.950234 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.951165 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.951707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.962209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:48.973749 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:48.975426 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:48.977069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fdd7df7f-bbf1-46bd-9926-14a7d584ec82 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.260174 Jul 18 15:18:48.986649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:48.987208 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:48.987772 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lazy-loading 'fault' on Instance uuid 9f39d887-9b8a-4bda-9ddc-83c684c699f5 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:48.987918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 363/722] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:48 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:48.999757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:49.000575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:49.007814 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:49.008586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:49.009567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:49.010182 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:49.052312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:49.063668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ebe0be9e-9052-42f1-aa64-9f02d65fcb18 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1324 microversion: 2.1 time: 0.129091 Jul 18 15:18:49.064483 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 360/723] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:48 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1324 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:49.179069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:49.187201 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-25e25a23-a801-443b-8b30-b518b4bc3590 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1556 microversion: 2.1 time: 0.198184 Jul 18 15:18:49.187798 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 364/724] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:48 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:49.950162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:49.950735 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:49.958085 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:49.958569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:49.959394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:49.959835 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:49.999368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:50.000428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:50.011071 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.011819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.012645 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.013339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.156930 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.166278 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6693d061-6b61-40da-93be-6783ac500287 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1450 microversion: 2.1 time: 0.220500 Jul 18 15:18:50.166921 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 361/725] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:49 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1450 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:50.172180 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:50.173012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:50.180457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.181151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.182443 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.183259 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.229754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.230219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.230867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lazy-loading 'fault' on Instance uuid 9f39d887-9b8a-4bda-9ddc-83c684c699f5 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:50.277437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.281516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.289277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-68beda58-3290-4670-abd8-709dc2b9a899 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 200 len: 1324 microversion: 2.1 time: 0.120704 Jul 18 15:18:50.299733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 362/726] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:50 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 1324 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:50.299733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:50.299733 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:50.312331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.313337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.313697 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.314509 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.315066 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.317291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.322872 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3cbec5c5-9970-43cd-ab1c-cc4eeffae8ca tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.327930 Jul 18 15:18:50.326792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 365/727] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:49 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:50.346961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:50.352119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:50.375132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.376009 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.377573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.386927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.503548 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.512482 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-059ff944-0c79-448c-b2d2-618307a15916 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1514 microversion: 2.1 time: 0.179962 Jul 18 15:18:50.520147 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 366/728] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:50 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:50.522844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:50.525903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-dd7e0993-036e-4b9b-9870-ec8c9cd46cda req-3391a814-75e9-4a80-a86a-4f85e43623b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b701eaa8-49d9-4517-861d-df2653859765", "name": "network-vif-deleted", "tag": "b7362e28-3d73-4fdc-b428-2c67c361b97e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:50.531362 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-45118d77-273d-449a-a575-6ba5d7682742 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1450 microversion: 2.1 time: 0.240431 Jul 18 15:18:50.532044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 363/729] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:50 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1450 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:50.536177 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-dd7e0993-036e-4b9b-9870-ec8c9cd46cda req-3391a814-75e9-4a80-a86a-4f85e43623b8 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.542793 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-dd7e0993-036e-4b9b-9870-ec8c9cd46cda req-3391a814-75e9-4a80-a86a-4f85e43623b8 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.553666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-dd7e0993-036e-4b9b-9870-ec8c9cd46cda req-3391a814-75e9-4a80-a86a-4f85e43623b8 service nova] Creating event network-vif-deleted:b7362e28-3d73-4fdc-b428-2c67c361b97e for instance b701eaa8-49d9-4517-861d-df2653859765 on hv-cinder-83697 Jul 18 15:18:50.561733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-dd7e0993-036e-4b9b-9870-ec8c9cd46cda req-3391a814-75e9-4a80-a86a-4f85e43623b8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040129 Jul 18 15:18:50.562656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 367/730] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:50.683311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-a1e5987d-4ea0-4a3c-8a20-bd44b8c75dc9 req-7143eb30-dd04-44f7-be2e-955607de12b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "name": "network-vif-plugged", "status": "completed", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:50.700412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a1e5987d-4ea0-4a3c-8a20-bd44b8c75dc9 req-7143eb30-dd04-44f7-be2e-955607de12b1 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:50.700864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a1e5987d-4ea0-4a3c-8a20-bd44b8c75dc9 req-7143eb30-dd04-44f7-be2e-955607de12b1 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:50.714971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-a1e5987d-4ea0-4a3c-8a20-bd44b8c75dc9 req-7143eb30-dd04-44f7-be2e-955607de12b1 service nova] Creating event network-vif-plugged:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:18:50.721267 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-a1e5987d-4ea0-4a3c-8a20-bd44b8c75dc9 req-7143eb30-dd04-44f7-be2e-955607de12b1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046659 Jul 18 15:18:50.721931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 364/731] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:51.308660 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:51.319176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:51.319176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.319176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.319693 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.320541 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.339125 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] HTTP exception thrown: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Request method failure captured: Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 HTTP/1.1 Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xiha2u9sPk9JX0kiquGFuePTCPnBa9Fk7_tqezgLuJmK8Y_eh-ipT4_ROWN_x4wVj677Wm8FIANYKLCw5QQ5Yl21dX_4XD1rggREZ6wNtP390R0qWGYNWoZv2F3BrHYpT0lH3OzAfJHkfcI0q9-RIPS1bN3lLibSWMaqnISpt3mxiw Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:18:51.340840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7cb30e124ce7458f9c29e6c6ae3d95f0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 22b86eef7820462fa4e6cbb22f30b853 Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:18:51.343055 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '9f39d887-9b8a-4bda-9ddc-83c684c699f5'} Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:18:51.344684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:18:51.346233 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:18:51.349011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Returning 404 to user: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:18:51.349011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-17ab7ae5-c6dc-4811-a6f2-e5bedb0c4685 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 404 len: 111 microversion: 2.1 time: 0.039547 Jul 18 15:18:51.349011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 368/732] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:51 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:18:51.349301 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:51.349301 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:51.357075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.357518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ae8776af-7c75-4238-9de5-199858f6c1ff tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '.version_select at 0x7f48c1e1c700>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:51.359469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.359469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.359469 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.366329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:18:51.463976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ae8776af-7c75-4238-9de5-199858f6c1ff tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208518" status: 202 len: 0 microversion: 2.1 time: 0.115467 Jul 18 15:18:51.465237 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 369/733] 10.222.0.83 () {58 vars in 1208 bytes} [Mon Jul 18 15:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208518 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:18:51.531506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:51.532341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:51.542663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.543803 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.544869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.545564 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.592843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:51.593627 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:51.594524 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lazy-loading 'fault' on Instance uuid b701eaa8-49d9-4517-861d-df2653859765 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:51.623935 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:51.643367 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:51.645359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:51.646755 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4ac5cb12-5595-42a8-bdc7-ae3c72aa05b6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.305347 Jul 18 15:18:51.648162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 365/734] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:51 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:18:51.670191 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b1df340f8a4102adf5f680d7e64139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8e493ee52b4c2686d5010eed312191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:51.680311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b8907906-e4e8-449c-998f-5338b573d4d7 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 200 len: 1349 microversion: 2.1 time: 0.152902 Jul 18 15:18:51.681170 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 370/735] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:51 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 1349 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:52.676668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:52.677843 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:52.678405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:52.679846 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:52.685254 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:52.685762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:52.686815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:52.687444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:52.690090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:52.691678 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:52.696718 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:52.696718 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:52.813960 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lazy-loading 'services' on Instance uuid 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:18:52.904246 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:52.913075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:52.915975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:52.917222 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6b466f5a-9568-4700-be7e-508f89b58d2c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1406 microversion: 2.20 time: 0.255500 Jul 18 15:18:52.917809 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 366/736] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:52 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:52.937726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:52.937726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] [instance: b701eaa8-49d9-4517-861d-df2653859765] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:52.937726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:52.937726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:52.938259 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:52.938259 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:52.951000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] HTTP exception thrown: Instance b701eaa8-49d9-4517-861d-df2653859765 could not be found. Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Request method failure captured: Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 HTTP/1.1 Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xj4dBV-I08LLOjiphIz9foAWiKPjR35M8uNOk0gh5Z4dUU6ZpHdJRPsSu3vnJ0lyPBTV3mORRQy2dLDYNqxjbOLSRAeebCOKoQnwMPCXWbM05KacHZq1JC25CM19967cnQaXxtQ9g4INwW4DMk4jFOHBvLe1Ffo5kv9na_itzG5p2Q Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: eb8e493ee52b4c2686d5010eed312191 Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-TestMinimumBasicScenario-840208564 Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:18:52.952685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb8e493ee52b4c2686d5010eed312191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb8e493ee52b4c2686d5010eed312191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb8e493ee52b4c2686d5010eed312191", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb8e493ee52b4c2686d5010eed312191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-TestMinimumBasicScenario-840208564 Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: eb8e493ee52b4c2686d5010eed312191 Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-TestMinimumBasicScenario-840208564 Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-TestMinimumBasicScenario-840208564-project Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 45b1df340f8a4102adf5f680d7e64139 Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-TestMinimumBasicScenario-840208564-project Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance b701eaa8-49d9-4517-861d-df2653859765 could not be found. Jul 18 15:18:52.954307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': 'b701eaa8-49d9-4517-861d-df2653859765'} Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b701eaa8-49d9-4517-861d-df2653859765 could not be found. Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:18:52.961160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b701eaa8-49d9-4517-861d-df2653859765 could not be found. Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b701eaa8-49d9-4517-861d-df2653859765 could not be found. Jul 18 15:18:52.962709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:18:52.964027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Returning 404 to user: Instance b701eaa8-49d9-4517-861d-df2653859765 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:18:52.964027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2ab49073-4681-4596-ac89-199533b42824 tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765" status: 404 len: 111 microversion: 2.1 time: 0.035304 Jul 18 15:18:52.964027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 367/737] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:52 2022] GET /compute/v2.1/servers/b701eaa8-49d9-4517-861d-df2653859765 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:18:52.964027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-99f22c03-5892-45b9-b609-948eefcce5ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: .version_select at 0x7f48c14ff5e0>, body: {"keypair": {"name": "tempest-keypair-1588280028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwrS4ZETBq+S9R9EBINYxcaYZaB4A9fZBpOIuC8OYCPbVQJkjBrljt4s2PS0su8e5+vrf2IaAAEAokMyMh8Gc8AdMgSpq8VGbBQd7K9/Xd4zg7A7NucugffbXavwcQ3jw=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:52.974691 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-99f22c03-5892-45b9-b609-948eefcce5ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:18:52.979762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-99f22c03-5892-45b9-b609-948eefcce5ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for user 22b86eef7820462fa4e6cbb22f30b853 and project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:18:53.127692 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-99f22c03-5892-45b9-b609-948eefcce5ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171532 Jul 18 15:18:53.134302 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 368/738] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:18:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:53.136700 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e3c4736c-85e3-4068-9d86-e3157917ddbe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] Calling method '.version_select at 0x7f48c5e98dc0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:53.148851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8c760a7f-74db-40f0-87a7-a17776ff6dcb tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e/os-volume_attachments/645df6f7-b7fb-4761-a101-a9397d40b09b" status: 202 len: 0 microversion: 2.1 time: 0.474311 Jul 18 15:18:53.149859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 371/739] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:18:52 2022] DELETE /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e/os-volume_attachments/645df6f7-b7fb-4761-a101-a9397d40b09b => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:18:53.281143 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e3c4736c-85e3-4068-9d86-e3157917ddbe tempest-TestMinimumBasicScenario-840208564 tempest-TestMinimumBasicScenario-840208564-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1941132642" status: 202 len: 0 microversion: 2.1 time: 0.150741 Jul 18 15:18:53.282057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 369/740] 10.222.0.83 () {58 vars in 1271 bytes} [Mon Jul 18 15:18:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1941132642 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:18:53.526905 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-1047b716-16ae-4822-9f9e-ddb11ab32035 req-e93e4dfa-7409-45c9-aea8-37f8d4659b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0a0fa7-898e-4bdd-9a61-8ed362f942be", "tag": "2d834c80-f254-424d-8f17-9e435fae87c0"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:53.538124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-1047b716-16ae-4822-9f9e-ddb11ab32035 req-e93e4dfa-7409-45c9-aea8-37f8d4659b78 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:53.538805 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-1047b716-16ae-4822-9f9e-ddb11ab32035 req-e93e4dfa-7409-45c9-aea8-37f8d4659b78 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:53.558840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-1047b716-16ae-4822-9f9e-ddb11ab32035 req-e93e4dfa-7409-45c9-aea8-37f8d4659b78 service nova] Creating event network-changed:2d834c80-f254-424d-8f17-9e435fae87c0 for instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be on hv-cinder-83697 Jul 18 15:18:53.574037 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-1047b716-16ae-4822-9f9e-ddb11ab32035 req-e93e4dfa-7409-45c9-aea8-37f8d4659b78 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051942 Jul 18 15:18:53.575653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 372/741] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:53.946831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:53.947540 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:53.954369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:53.956370 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:53.964063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:53.965308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:54.171642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:54.192649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:54.197952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:54.203967 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8a30205f-f1cf-454a-914d-859bd0414916 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1598 microversion: 2.20 time: 0.260034 Jul 18 15:18:54.206293 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 370/742] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:18:53 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1598 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:18:54.226461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:54.227116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:54.237597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:54.238520 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:54.239566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:54.241042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:54.385589 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8c82aee1-8666-490e-93c8-4f3eed39ae6d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.164760 Jul 18 15:18:54.386469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 373/743] 10.222.0.83 () {60 vars in 1315 bytes} [Mon Jul 18 15:18:54 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 15:18:55.430274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:55.431554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:55.439529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:55.440042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:55.441154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:55.441615 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:55.474504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:18:55.906262 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7d7626b1-3c69-4542-9fcc-20166c15b825 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 204 len: 0 microversion: 2.1 time: 0.480581 Jul 18 15:18:55.907603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 371/744] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:18:55 2022] DELETE /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:18:55.926101 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:55.928428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:55.937895 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:55.938431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:55.939369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:55.940081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:56.349243 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:56.361045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c65ddb6-0209-4e25-94c4-e0fe81c8717f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1513 microversion: 2.1 time: 0.440611 Jul 18 15:18:56.362029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 374/745] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:55 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1513 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:56.817891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1859698086", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a80d15bf-5cb0-4f8d-8fa5-fa459e419fab"}], "security_groups": [{"name": "tempest-securitygroup--963896723"}], "key_name": "tempest-keypair-1588280028", "user_data": "}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:56.952444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] validate_networks() for [('a80d15bf-5cb0-4f8d-8fa5-fa459e419fab', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:18:56.994590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-cbe88c39-8ec6-431f-88ab-b96ef4ae05d0 req-6f13eb8e-255d-499a-a244-7d29f08129d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:57.004458 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cbe88c39-8ec6-431f-88ab-b96ef4ae05d0 req-6f13eb8e-255d-499a-a244-7d29f08129d7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:57.005239 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cbe88c39-8ec6-431f-88ab-b96ef4ae05d0 req-6f13eb8e-255d-499a-a244-7d29f08129d7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:57.021029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-cbe88c39-8ec6-431f-88ab-b96ef4ae05d0 req-6f13eb8e-255d-499a-a244-7d29f08129d7 service nova] Creating event network-changed:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:18:57.027801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-cbe88c39-8ec6-431f-88ab-b96ef4ae05d0 req-6f13eb8e-255d-499a-a244-7d29f08129d7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039423 Jul 18 15:18:57.029199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 375/746] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:18:57.387251 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:57.388722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:57.396820 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:57.397363 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:57.398373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:57.398928 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:57.496009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:18:57.497044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:18:57.497655 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:18:57.498145 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:18:57.499441 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:18:57.512061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:57.512884 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:57.514292 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:57.514960 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:57.538137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:18:57.544426 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Getting quotas for user 22b86eef7820462fa4e6cbb22f30b853 and project 7cb30e124ce7458f9c29e6c6ae3d95f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:18:57.563913 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:18:57.567288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:18:57.770820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-51590d05-b0b6-4b8a-ba3a-a758d3afb3ad tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.957718 Jul 18 15:18:57.773730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 372/747] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:18:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:18:57.787080 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-546b5652-de43-4555-8068-dabb453acdb2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:57.787080 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-546b5652-de43-4555-8068-dabb453acdb2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:57.861988 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-546b5652-de43-4555-8068-dabb453acdb2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:57.870265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:57.878104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-546b5652-de43-4555-8068-dabb453acdb2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1238 microversion: 2.1 time: 0.098878 Jul 18 15:18:57.882669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 373/748] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:57 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:57.894064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef9a016c-51ac-40a1-9a0d-8c790469034b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1513 microversion: 2.1 time: 0.515805 Jul 18 15:18:57.895250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 376/749] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:57 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:58.904759 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a8a6b302-1fc0-45e7-8152-1f0a4825100f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:58.905690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a8a6b302-1fc0-45e7-8152-1f0a4825100f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:58.917931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:18:58.919569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:18:58.932631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:58.933152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:58.933976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:58.934423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:59.026129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a8a6b302-1fc0-45e7-8152-1f0a4825100f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:59.035739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a8a6b302-1fc0-45e7-8152-1f0a4825100f tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1238 microversion: 2.1 time: 0.135176 Jul 18 15:18:59.037676 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 374/750] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:58 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:18:59.240992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:18:59.252850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-52e4d6a5-5ad3-417f-b163-9dc3f175dd92 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1513 microversion: 2.1 time: 0.338938 Jul 18 15:18:59.254409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 377/751] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:18:58 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:18:59.288401 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-b584e0bc-52a8-4838-a963-cb72d3770c99 req-a9a2c979-d073-484a-a081-02a6ccf99dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e", "name": "network-vif-deleted", "tag": "7378b582-67ac-41b6-ac1b-cfbd2f8feedd"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:18:59.299145 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-b584e0bc-52a8-4838-a963-cb72d3770c99 req-a9a2c979-d073-484a-a081-02a6ccf99dc2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:18:59.299928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-b584e0bc-52a8-4838-a963-cb72d3770c99 req-a9a2c979-d073-484a-a081-02a6ccf99dc2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:18:59.314515 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-b584e0bc-52a8-4838-a963-cb72d3770c99 req-a9a2c979-d073-484a-a081-02a6ccf99dc2 service nova] Creating event network-vif-deleted:7378b582-67ac-41b6-ac1b-cfbd2f8feedd for instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e on hv-cinder-83697 Jul 18 15:18:59.320932 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-b584e0bc-52a8-4838-a963-cb72d3770c99 req-a9a2c979-d073-484a-a081-02a6ccf99dc2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 Jul 18 15:18:59.321778 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 375/752] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:00.059149 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:00.060014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:00.071782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:00.072615 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:00.074073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:00.074947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:00.112499 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:00.169831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:00.178259 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f3a86ec3-4320-48bd-83a7-2193ac439930 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1290 microversion: 2.1 time: 0.126060 Jul 18 15:19:00.189048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 378/753] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:00 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1290 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:00.275845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:00.277189 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:00.291014 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:00.291762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:00.292572 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:00.293407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:00.330826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:00.331310 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:00.331779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lazy-loading 'fault' on Instance uuid 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:19:00.392357 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:00.402400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8dbafb13-811d-443a-bf3d-3af769270f8a tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 200 len: 1309 microversion: 2.1 time: 0.132204 Jul 18 15:19:00.403545 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 376/754] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:00 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:01.198885 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:01.199490 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:01.201918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:01.207222 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:01.207690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:01.208509 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:01.208925 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:01.328671 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:01.338444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-af210c40-d889-4af2-999e-eacfa7f55a9e tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1296 microversion: 2.1 time: 0.144440 Jul 18 15:19:01.349349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 379/755] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:01 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:01.422114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:01.422806 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:01.433078 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:01.434737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:01.435492 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:01.436013 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:01.436464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:01.453233 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] HTTP exception thrown: Instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e could not be found. Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Request method failure captured: Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e HTTP/1.1 Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XmCGlCjY0t_18JBjAa1KOuNbX110EvXhrL6B3jfCesnOy7g2L2ZrACZbrDXDCp60CwDv_CrM5Ft8j164wa9JnfIJJK25Geu-ar-krHI4wItgJzfrxqimpx4syYA_qyE8HlEg-YFxJ9b5iDyrkwkgCZkAs80qlurIt-uJSR9wwKAAsY Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: fcd59138153e461bb239770cc1bbc1f1 Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1331677335 Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:19:01.455322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fcd59138153e461bb239770cc1bbc1f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fcd59138153e461bb239770cc1bbc1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fcd59138153e461bb239770cc1bbc1f1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fcd59138153e461bb239770cc1bbc1f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesSnapshotTestJSON-1331677335 Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: fcd59138153e461bb239770cc1bbc1f1 Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1331677335 Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesSnapshotTestJSON-1331677335-project Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 4746f061cfd148609ffaf568f869d6d8 Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesSnapshotTestJSON-1331677335-project Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e could not be found. Jul 18 15:19:01.456762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e'} Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e could not be found. Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:19:01.457548 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e could not be found. Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e could not be found. Jul 18 15:19:01.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:01.465852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Returning 404 to user: Instance 6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:19:01.465852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6651da76-5e74-4a92-8b0a-07ed9a7d4ca4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e" status: 404 len: 111 microversion: 2.1 time: 0.045023 Jul 18 15:19:01.465852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 377/756] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:01 2022] GET /compute/v2.1/servers/6a1e6ee0-e53b-4e43-b319-49faf4cdaf9e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:19:02.359064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:02.359693 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:02.368437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:02.369421 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:02.369708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:02.370144 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:02.615578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:02.624309 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-17accfd1-6acb-41a0-b954-e1cf805076b3 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.270003 Jul 18 15:19:02.624911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 380/757] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:02 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:03.642713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:03.644044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:03.652434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:03.652928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:03.653987 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:03.654439 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:03.833328 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:03.842932 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-03d9d3db-0e5c-4c07-9b36-fd3ea557a5df tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.204891 Jul 18 15:19:03.848332 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 378/758] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:03 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:04.861395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:04.862260 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:04.870737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:04.876558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:04.876558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:04.876558 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:05.528452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:05.528452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-81b47457-384d-4d97-83ea-31732034bee9 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.590376 Jul 18 15:19:05.528452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 381/759] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:04 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:06.040714 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-7b5ba78b-6c46-414d-ad79-e8bc2ad8f893 req-23c0cd5e-3134-42fa-b45d-26728541677b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1", "tag": "6d25626f-5301-4222-b3c1-fc3264ffecec"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:06.050655 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-7b5ba78b-6c46-414d-ad79-e8bc2ad8f893 req-23c0cd5e-3134-42fa-b45d-26728541677b service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:06.051164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-7b5ba78b-6c46-414d-ad79-e8bc2ad8f893 req-23c0cd5e-3134-42fa-b45d-26728541677b service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:06.067583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-7b5ba78b-6c46-414d-ad79-e8bc2ad8f893 req-23c0cd5e-3134-42fa-b45d-26728541677b service nova] Creating event network-changed:6d25626f-5301-4222-b3c1-fc3264ffecec for instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 on hv-cinder-83697 Jul 18 15:19:06.073971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-7b5ba78b-6c46-414d-ad79-e8bc2ad8f893 req-23c0cd5e-3134-42fa-b45d-26728541677b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114113 Jul 18 15:19:06.074990 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 379/760] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:06.504005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:06.506414 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:06.533289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:06.534273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:06.536176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:06.537270 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:06.887778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:06.896790 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a2b59257-9f31-47d4-80d8-7b6e616c0c4c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.406314 Jul 18 15:19:06.897729 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 382/761] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:06 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:07.277101 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:07.278308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:07.287676 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:07.289201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:07.290288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:07.290836 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:07.388097 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lazy-loading 'services' on Instance uuid ea90bbda-13c2-40f9-bd93-daa1e79f27dd {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:19:07.528171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:07.650360 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e1c92201-9b02-4232-8e89-5829ff41a753 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments/f12db057-e3fd-4dab-b040-3cbd56cbacbf" status: 202 len: 0 microversion: 2.1 time: 0.381506 Jul 18 15:19:07.654391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 380/762] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:19:07 2022] DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments/f12db057-e3fd-4dab-b040-3cbd56cbacbf => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:19:07.662172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:07.663328 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:07.672116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:07.672631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:07.673539 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:07.674086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:07.708014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9c1c8f7f-2eb1-4958-8718-1a46843e0cd4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051986 Jul 18 15:19:07.708605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 383/763] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:19:07 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:07.917094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:07.918011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:07.927841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:07.927841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:07.927841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:07.927841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:08.093850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:08.114274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f1e2d5f5-9111-4415-8a30-550ee2197aa8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.202249 Jul 18 15:19:08.114983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 381/764] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:07 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:08.727237 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:08.727237 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:08.731160 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:08.731628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:08.732430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:08.732929 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:08.768063 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-737dd3a9-d548-4dc5-8821-249e8c2945c4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049986 Jul 18 15:19:08.768672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 384/765] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:19:08 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:19:09.140349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:09.140973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:09.143536 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=14 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:09.151021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:09.152985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:09.152985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:09.153197 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:09.309678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:09.320470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-41c28062-74a7-40d5-8664-0088a5b9b640 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.181909 Jul 18 15:19:09.320470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 382/766] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:09 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:09.780870 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:09.782169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:09.790422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:09.791210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:09.792295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:09.792850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:09.828704 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9472e9a3-1307-4554-a91f-1b9d702baea7 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052269 Jul 18 15:19:09.829307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 385/767] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:19:09 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:10.338197 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:10.339031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:10.346911 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:10.347366 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:10.348151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:10.348585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:10.500125 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:10.508226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-197bffc4-ca5a-4461-9ce3-3662ba642dcd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.175730 Jul 18 15:19:10.508811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 383/768] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:10 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:10.842882 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:10.843806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:10.850889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:10.851348 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:10.852254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:10.852697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:10.883666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ed2582a3-2004-4395-9e29-d2c0bc14cb0b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Jul 18 15:19:10.884245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 386/769] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:19:10 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:11.524883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:11.525567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:11.532324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:11.532828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:11.533628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:11.534190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:11.700641 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:11.709598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e40ef950-25b1-48e2-8ccf-73d53303aa80 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.188821 Jul 18 15:19:11.710297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 384/770] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:11 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:11.896145 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:11.898422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:11.908773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:11.909227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:11.910016 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:11.910463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:11.942578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ac1acf29-8f7f-47ad-afbd-95406cb3dcc4 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050725 Jul 18 15:19:11.943169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 387/771] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:19:11 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:12.315468 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-576023919", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "networks": [{"uuid": "40c301cd-c53a-4206-aeb7-9b2605a4022b"}]}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:12.367704 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] validate_networks() for [('40c301cd-c53a-4206-aeb7-9b2605a4022b', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:19:12.730156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:12.730916 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:12.737234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:12.737856 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:12.738756 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:12.739327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:12.749805 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:19:12.750303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:19:12.750749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:19:12.751167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:19:12.751585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:19:12.767190 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:12.767675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:12.768453 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:12.768890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:12.793957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Getting quotas for project fcd59138153e461bb239770cc1bbc1f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:19:12.799089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Getting quotas for user 4746f061cfd148609ffaf568f869d6d8 and project fcd59138153e461bb239770cc1bbc1f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:19:12.813085 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:19:12.815441 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:19:12.889012 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:12.896947 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c592456b-9ecb-4895-8804-ebdb53d7e84d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.171373 Jul 18 15:19:12.898245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 388/772] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:12 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:12.953672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:12.954637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:12.961672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:12.962129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:12.962934 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:12.963371 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.001543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1b8623d9-92c4-46cd-bb0f-7b02537e2217 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049258 Jul 18 15:19:13.001543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 389/773] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:19:12 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 15:19:13.010761 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3d97c7dc-e439-4b66-a254-b6f261c18a11 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699015 Jul 18 15:19:13.011650 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 385/774] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:19:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:19:13.021747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d3fdeb7b-44e6-406a-aee8-409dc2dead3f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:13.022400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d3fdeb7b-44e6-406a-aee8-409dc2dead3f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:13.087867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d3fdeb7b-44e6-406a-aee8-409dc2dead3f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:13.092096 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:13.092260 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d3fdeb7b-44e6-406a-aee8-409dc2dead3f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1218 microversion: 2.1 time: 0.074548 Jul 18 15:19:13.092604 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:13.093113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 390/775] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:13 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:13.100098 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.102085 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.102923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.103542 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.134892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:19:13.152668 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:13.467964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-116517cd-93e8-4de5-abbf-90875b5f5fbf req-675a7cb3-2d9c-416a-bf01-e4e3e419745a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1", "name": "network-vif-plugged", "status": "completed", "tag": "6d25626f-5301-4222-b3c1-fc3264ffecec"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:13.477956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-116517cd-93e8-4de5-abbf-90875b5f5fbf req-675a7cb3-2d9c-416a-bf01-e4e3e419745a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.478411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-116517cd-93e8-4de5-abbf-90875b5f5fbf req-675a7cb3-2d9c-416a-bf01-e4e3e419745a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.503127 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-116517cd-93e8-4de5-abbf-90875b5f5fbf req-675a7cb3-2d9c-416a-bf01-e4e3e419745a service nova] Creating event network-vif-plugged:6d25626f-5301-4222-b3c1-fc3264ffecec for instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 on hv-cinder-83697 Jul 18 15:19:13.510091 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-116517cd-93e8-4de5-abbf-90875b5f5fbf req-675a7cb3-2d9c-416a-bf01-e4e3e419745a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045254 Jul 18 15:19:13.510752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 391/776] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:13.626104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fa976f8f-b39b-4522-9c6a-3e4b04c7d77e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 204 len: 0 microversion: 2.1 time: 0.538045 Jul 18 15:19:13.626749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 386/777] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:19:13 2022] DELETE /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:19:13.637606 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:13.645036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:13.645036 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.645289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.646051 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.646492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.799066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:13.807717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9ad46332-8de3-45ad-804e-a68b7449bc1a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1690 microversion: 2.1 time: 0.175546 Jul 18 15:19:13.808313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 392/778] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:13 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:13.918946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:13.919736 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:13.926824 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.927295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:13.928090 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:13.928560 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:14.080698 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:14.088556 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0ae45ef4-32b1-49f1-806c-1aaa8dff96cd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.175050 Jul 18 15:19:14.089141 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 387/779] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:13 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:14.112907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:14.113571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:14.122487 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:14.122874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:14.123683 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:14.124121 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:14.189741 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:14.198828 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a4878a78-a44d-4801-a8a0-c34af88ecc2f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1222 microversion: 2.1 time: 0.090185 Jul 18 15:19:14.199420 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 393/780] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:14 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:14.824936 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:14.825545 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:14.832293 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:14.832747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:14.833686 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:14.833975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:14.980139 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:14.988336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ae1a3df9-2232-458b-8a2c-fbf6656c001e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1690 microversion: 2.1 time: 0.167330 Jul 18 15:19:14.988918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 388/781] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:14 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:15.107406 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:15.107406 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:15.112974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:15.113603 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:15.114171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:15.114680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:15.216393 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:15.217175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:15.223858 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:15.224395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:15.225944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:15.226392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:15.253687 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:15.261709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0a0d9ad4-405a-42f6-a321-37a7f5cc2bf1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.159471 Jul 18 15:19:15.262303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 394/782] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:15 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:15.294459 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:15.307932 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-400d96ee-4668-4b64-84b0-5bc857572405 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1222 microversion: 2.1 time: 0.095520 Jul 18 15:19:15.308568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 389/783] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:15 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:16.005353 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:16.005957 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:16.012774 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:16.013232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:16.014003 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:16.014438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:16.153485 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:16.161168 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c9e33aaa-5a72-4ae6-80b0-f100a32eb1cf tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1690 microversion: 2.1 time: 0.159700 Jul 18 15:19:16.162098 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 395/784] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:16 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:16.279496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:16.280131 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:16.286974 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:16.287429 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:16.288252 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:16.288683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:16.328092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:16.328870 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:16.336612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:16.338834 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:16.339795 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:16.340240 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:16.406855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:16.410493 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:16.415438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e0b51f77-fd3e-44e0-b2ea-d191dc3f142c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1222 microversion: 2.1 time: 0.091359 Jul 18 15:19:16.416480 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 396/785] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:16 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:16.436089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:16.448169 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a942e41c-0a2a-4afd-9905-a99daf84176a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.172559 Jul 18 15:19:16.448866 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 390/786] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:16 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:17.179843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:17.180584 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:17.187901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:17.188350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:17.189163 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:17.189630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:17.331669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:17.339863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2fc26023-390e-4d0f-96fb-d3bf5612281e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1690 microversion: 2.1 time: 0.165311 Jul 18 15:19:17.340444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 397/787] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:17 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:17.435238 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:17.435801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:17.442522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:17.442983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:17.443773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:17.444290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:17.466342 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:17.466989 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:17.473474 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:17.473921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:17.475053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:17.476275 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:17.511849 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:17.519868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fae550c2-b478-4c2e-b9d9-f2904fb8176e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1214 microversion: 2.1 time: 0.090910 Jul 18 15:19:17.521408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 391/788] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:17 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:17.644895 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:17.652855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ebc92e0f-dc11-47d0-9068-8733a707421c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.190307 Jul 18 15:19:17.653457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 398/789] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:17 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:18.358078 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:18.359126 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:18.365578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:18.366661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:18.367526 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:18.368050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:18.518518 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:18.528284 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f55b4d46-41bd-4722-9297-d675aef5ef4a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1690 microversion: 2.1 time: 0.174139 Jul 18 15:19:18.528852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 392/790] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:18 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:18.537369 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:18.539086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:18.546964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:18.547699 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:18.548647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:18.549298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:18.657901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:18.667663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f1b6a3e-0fe5-429f-9ce1-90a540272f00 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1270 microversion: 2.1 time: 0.134097 Jul 18 15:19:18.668825 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 399/791] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:18 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:18.680194 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:18.681048 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:18.696947 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:18.697923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:18.698794 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:18.699241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:18.843059 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:18.852038 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a35054dc-0fd9-4ce1-a366-828ac67d670c tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1363 microversion: 2.1 time: 0.177895 Jul 18 15:19:18.852656 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 393/792] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:18 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:19.280113 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-7107129f-b7c9-4c99-8660-6f0ea87abb5f req-ee770ed6-fb6b-4256-99ca-69b8eb14657a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea90bbda-13c2-40f9-bd93-daa1e79f27dd", "name": "network-vif-deleted", "tag": "e9e943a0-f833-4d66-8068-fd9533d671de"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:19.295908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7107129f-b7c9-4c99-8660-6f0ea87abb5f req-ee770ed6-fb6b-4256-99ca-69b8eb14657a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.298815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7107129f-b7c9-4c99-8660-6f0ea87abb5f req-ee770ed6-fb6b-4256-99ca-69b8eb14657a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:19.326198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-7107129f-b7c9-4c99-8660-6f0ea87abb5f req-ee770ed6-fb6b-4256-99ca-69b8eb14657a service nova] Creating event network-vif-deleted:e9e943a0-f833-4d66-8068-fd9533d671de for instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd on hv-cinder-83697 Jul 18 15:19:19.338166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-7107129f-b7c9-4c99-8660-6f0ea87abb5f req-ee770ed6-fb6b-4256-99ca-69b8eb14657a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062198 Jul 18 15:19:19.338847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 400/793] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:19.545545 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:19.546802 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:19.555086 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.563050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:19.564214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.564895 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:19.671376 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:19.691386 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:19.692865 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:19.697079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-48097ca1-7d60-4af2-b679-a219af654d45 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 200 len: 1331 microversion: 2.1 time: 0.154958 Jul 18 15:19:19.699082 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 394/794] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:19 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 1331 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:19.708830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.709289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:19.710393 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.715538 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:19.798948 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:19.808097 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc55bed6-3d32-4623-a796-20c11a5e4afd tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1288 microversion: 2.1 time: 0.121499 Jul 18 15:19:19.808618 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 401/795] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:19 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1288 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:19.869854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:19.871850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:19.878879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.879344 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:19.880490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:19.881218 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.122212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:20.143265 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b409b76d-ed61-442d-a44b-de4dedd927d2 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1549 microversion: 2.1 time: 0.278417 Jul 18 15:19:20.150853 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 395/796] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:19 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1549 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:20.160647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:20.161452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:20.168970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:20.168970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.169936 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:20.170451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.275027 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bd4906b7-7bf7-49fa-8f1e-c44d8b9040f1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118302 Jul 18 15:19:20.275653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 402/797] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:19:20 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:20.717589 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:20.718314 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: ea90bbda-13c2-40f9-bd93-daa1e79f27dd] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:20.728787 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:20.729437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.730379 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:20.730938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.747972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] HTTP exception thrown: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd could not be found. Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Request method failure captured: Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd HTTP/1.1 Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XilQOYHXnhdj8LVhm7yZ74HO2Lcn7vbfHWa-RSIfxRpuNTHr6-zMoophvAWGrAJjebPvYyHYWva1LAM5w9F1HEcJaB67vDQDlBjZEG_w9tq_Qi3149rOCGtxWQp4jBQHRz5XSFm1jGrr9iWAPcw-e-hec50dMNiV7D_ksgh51StYiE Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:19:20.749677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0e83fff7c7524da9905cdb86ccdb565a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 648c869550ee437a8e775e997c741e58 Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd could not be found. Jul 18 15:19:20.751272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': 'ea90bbda-13c2-40f9-bd93-daa1e79f27dd'} Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd could not be found. Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:19:20.752122 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd could not be found. Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd could not be found. Jul 18 15:19:20.754083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:20.756112 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Returning 404 to user: Instance ea90bbda-13c2-40f9-bd93-daa1e79f27dd could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:19:20.756112 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8ddd340a-32e5-4704-aca7-fab5c164092e tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd" status: 404 len: 111 microversion: 2.1 time: 0.037598 Jul 18 15:19:20.756112 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 396/798] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:20 2022] GET /compute/v2.1/servers/ea90bbda-13c2-40f9-bd93-daa1e79f27dd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:19:20.762717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d519ac9d-b725-450e-a100-209b96d8dd5b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '.version_select at 0x7f48c13e4700>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:20.830280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:20.830824 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:20.839542 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:20.840004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.840955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:20.841405 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:20.897964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d519ac9d-b725-450e-a100-209b96d8dd5b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337440721" status: 202 len: 0 microversion: 2.1 time: 0.139687 Jul 18 15:19:20.902230 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 403/799] 10.222.0.83 () {58 vars in 1220 bytes} [Mon Jul 18 15:19:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337440721 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:19:21.200878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:21.212361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-47b21006-4990-44a6-8fc2-b75480e2bef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.389879 Jul 18 15:19:21.212984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 397/800] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:20 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:22.239575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:22.240197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:22.249311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:22.249837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:22.250718 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:22.251194 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:22.449864 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:22.460409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4eb4fa03-f071-4ecb-9276-05cf3710b14f tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.224865 Jul 18 15:19:22.470237 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 404/801] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:22 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:22.537559 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-38adebc2-8b19-4271-8021-a81b31aa4b33 req-7eb7224d-45bf-4d63-9324-19c74064d882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1", "tag": "6d25626f-5301-4222-b3c1-fc3264ffecec"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:22.550215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-38adebc2-8b19-4271-8021-a81b31aa4b33 req-7eb7224d-45bf-4d63-9324-19c74064d882 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:22.551363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-38adebc2-8b19-4271-8021-a81b31aa4b33 req-7eb7224d-45bf-4d63-9324-19c74064d882 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:22.580430 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-38adebc2-8b19-4271-8021-a81b31aa4b33 req-7eb7224d-45bf-4d63-9324-19c74064d882 service nova] Creating event network-changed:6d25626f-5301-4222-b3c1-fc3264ffecec for instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 on hv-cinder-83697 Jul 18 15:19:22.593177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-38adebc2-8b19-4271-8021-a81b31aa4b33 req-7eb7224d-45bf-4d63-9324-19c74064d882 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215680 Jul 18 15:19:22.597521 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 398/802] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:19:23.478595 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:23.479874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:23.491808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:23.491808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:23.491808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:23.491808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:23.492561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:23.650136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:23.660520 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fab90e2f-ecbc-4c37-9ebe-9f32c8caeef0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.186347 Jul 18 15:19:23.661130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 405/803] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:23 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:24.613225 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:24.613968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:24.618354 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:24.619109 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:24.623183 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-46558893-eace-4195-83cf-5ef76b0eb751 req-5fb8ec41-721c-46a0-a91d-c9f36f05e30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f1e50e-cf63-4feb-be9b-632481fb4806", "tag": "551d3000-b6f0-432a-8a8f-f299320d6bf9"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:24.627156 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:24.627156 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:24.627156 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:24.627543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:24.632635 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-46558893-eace-4195-83cf-5ef76b0eb751 req-5fb8ec41-721c-46a0-a91d-c9f36f05e30e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:24.633091 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-46558893-eace-4195-83cf-5ef76b0eb751 req-5fb8ec41-721c-46a0-a91d-c9f36f05e30e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:24.644449 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-46558893-eace-4195-83cf-5ef76b0eb751 req-5fb8ec41-721c-46a0-a91d-c9f36f05e30e service nova] Creating event network-changed:551d3000-b6f0-432a-8a8f-f299320d6bf9 for instance 21f1e50e-cf63-4feb-be9b-632481fb4806 on hv-cinder-83697 Jul 18 15:19:24.650681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-46558893-eace-4195-83cf-5ef76b0eb751 req-5fb8ec41-721c-46a0-a91d-c9f36f05e30e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031172 Jul 18 15:19:24.651340 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 406/804] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:19:24.655997 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:19:24.680359 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:24.681096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:24.687830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:24.688511 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:24.691545 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:24.691545 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:24.914105 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:24.922694 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8bc95957-40f8-4c0d-a7cd-9a0675a962a7 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.247266 Jul 18 15:19:24.923292 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 407/805] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:24 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:19:25.010249 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-249844d8-1460-41ec-86b5-f00848ece6ab tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "DELETE /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 204 len: 0 microversion: 2.1 time: 0.398266 Jul 18 15:19:25.011095 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 399/806] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:19:24 2022] DELETE /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:19:25.019397 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:25.020016 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:25.026958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:25.027422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:25.028209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:25.028651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:25.234780 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:25.244209 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bcc97583-dc33-465e-8636-be99bfefa3f6 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1508 microversion: 2.1 time: 0.228823 Jul 18 15:19:25.246783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 408/807] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:25 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:25.943543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:25.945155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:25.952206 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:25.952675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:25.953434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:25.953868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:26.099616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:26.108188 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-83d886a5-dea4-459b-937e-4b6a8c9defe0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.169120 Jul 18 15:19:26.109052 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 400/808] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:25 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:26.262270 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:26.262939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:26.269869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:26.270326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:26.271163 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:26.271607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:26.421101 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:26.430011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4076ef21-4991-40fa-bc7b-45e24c134181 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1508 microversion: 2.1 time: 0.171744 Jul 18 15:19:26.430636 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 409/809] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:26 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:27.127232 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:27.128255 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:27.135955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:27.136411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:27.137205 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:27.137755 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:27.292907 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:27.298784 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:27.303418 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8509fa6e-4f91-4819-b888-0d203ac22a46 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.181235 Jul 18 15:19:27.304401 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 401/810] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:27 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:27.449041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:27.449666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:27.456732 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:27.457228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:27.459327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:27.459327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:27.563601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:27.585802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b19e79f8-62e2-4461-b41e-2594d60361fa tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1466 microversion: 2.1 time: 0.139457 Jul 18 15:19:27.586939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 410/811] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:27 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:27.657590 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-96713527-0046-427e-9d47-538d80741b3c req-a056bc8b-0d96-4869-a7d0-f5a9b8de3de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35578724-751f-4251-a982-8a758ca6a1a9", "name": "network-vif-deleted", "tag": "6d083045-63ac-45b2-9261-3a615cc1029a"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:27.667910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-96713527-0046-427e-9d47-538d80741b3c req-a056bc8b-0d96-4869-a7d0-f5a9b8de3de0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:27.668360 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-96713527-0046-427e-9d47-538d80741b3c req-a056bc8b-0d96-4869-a7d0-f5a9b8de3de0 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:27.682280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-96713527-0046-427e-9d47-538d80741b3c req-a056bc8b-0d96-4869-a7d0-f5a9b8de3de0 service nova] Creating event network-vif-deleted:6d083045-63ac-45b2-9261-3a615cc1029a for instance 35578724-751f-4251-a982-8a758ca6a1a9 on hv-cinder-83697 Jul 18 15:19:27.687916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-96713527-0046-427e-9d47-538d80741b3c req-a056bc8b-0d96-4869-a7d0-f5a9b8de3de0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035185 Jul 18 15:19:27.688532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 402/812] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:19:28.320988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:28.321632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:28.328063 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:28.328523 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:28.329310 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:28.329755 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:28.480341 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:28.488451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f56a4255-aa58-4f5e-baa2-6c97aefe35c0 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.171437 Jul 18 15:19:28.489044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 411/813] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:28 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:28.615193 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:28.615851 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:28.623603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:28.624070 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:28.624853 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:28.625285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:28.660603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:28.661068 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:28.661530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lazy-loading 'fault' on Instance uuid 35578724-751f-4251-a982-8a758ca6a1a9 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:19:28.707106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:28.715643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f47b3ae1-0e93-49c7-b4e4-eb991c60a60c tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 200 len: 1312 microversion: 2.1 time: 0.105023 Jul 18 15:19:28.716221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 403/814] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:28 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:29.507326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:29.507955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:29.514565 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.515056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.515842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.516473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.657921 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-a7dd2cf8-40c3-4f34-bf02-7a769f9d53ee req-5eefa8be-9e02-4ee1-852e-8a9bff7b2f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f1e50e-cf63-4feb-be9b-632481fb4806", "name": "network-vif-plugged", "status": "completed", "tag": "551d3000-b6f0-432a-8a8f-f299320d6bf9"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:29.665052 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:29.668142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a7dd2cf8-40c3-4f34-bf02-7a769f9d53ee req-5eefa8be-9e02-4ee1-852e-8a9bff7b2f61 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.668586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-a7dd2cf8-40c3-4f34-bf02-7a769f9d53ee req-5eefa8be-9e02-4ee1-852e-8a9bff7b2f61 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.673520 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3a92026a-a29d-4b54-b38b-ea29b5966812 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.170310 Jul 18 15:19:29.679801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 412/815] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:29 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:29.681719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-a7dd2cf8-40c3-4f34-bf02-7a769f9d53ee req-5eefa8be-9e02-4ee1-852e-8a9bff7b2f61 service nova] Creating event network-vif-plugged:551d3000-b6f0-432a-8a8f-f299320d6bf9 for instance 21f1e50e-cf63-4feb-be9b-632481fb4806 on hv-cinder-83697 Jul 18 15:19:29.686989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-a7dd2cf8-40c3-4f34-bf02-7a769f9d53ee req-5eefa8be-9e02-4ee1-852e-8a9bff7b2f61 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100285 Jul 18 15:19:29.687623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 404/816] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:19:29.734522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:29.735435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 35578724-751f-4251-a982-8a758ca6a1a9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:29.743671 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.744250 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.745247 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.745690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.760559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] HTTP exception thrown: Instance 35578724-751f-4251-a982-8a758ca6a1a9 could not be found. Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Request method failure captured: Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 HTTP/1.1 Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XilQOYHXnhdj8LVhm7yZ74HO2Lcn7vbfHWa-RSIfxRpuNTHr6-zMoophvAWGrAJjebPvYyHYWva1LAM5w9F1HEcJaB67vDQDlBjZEG_w9tq_Qi3149rOCGtxWQp4jBQHRz5XSFm1jGrr9iWAPcw-e-hec50dMNiV7D_ksgh51StYiE Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:19:29.762256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0e83fff7c7524da9905cdb86ccdb565a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 648c869550ee437a8e775e997c741e58 Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 35578724-751f-4251-a982-8a758ca6a1a9 could not be found. Jul 18 15:19:29.765632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '35578724-751f-4251-a982-8a758ca6a1a9'} Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35578724-751f-4251-a982-8a758ca6a1a9 could not be found. Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:19:29.766602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35578724-751f-4251-a982-8a758ca6a1a9 could not be found. Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35578724-751f-4251-a982-8a758ca6a1a9 could not be found. Jul 18 15:19:29.768379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:19:29.769770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Returning 404 to user: Instance 35578724-751f-4251-a982-8a758ca6a1a9 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:19:29.769770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-72b83ddb-e234-463f-b5b7-5539a5ecc71a tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9" status: 404 len: 111 microversion: 2.1 time: 0.034681 Jul 18 15:19:29.769770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 413/817] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:29 2022] GET /compute/v2.1/servers/35578724-751f-4251-a982-8a758ca6a1a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:19:29.775730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:29.776331 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:29.783294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.783760 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.784657 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:29.785111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:29.811606 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:19:30.240344 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3e105796-a4f5-4a3b-a7af-277c413a731f tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "DELETE /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 204 len: 0 microversion: 2.1 time: 0.469050 Jul 18 15:19:30.242587 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 405/818] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:19:29 2022] DELETE /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:19:30.251399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:30.252041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:30.259188 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:30.259649 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:30.260446 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:30.260887 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:30.399901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:30.407855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1581ac41-9ff7-475b-8b8d-e54a12f03a82 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.160577 Jul 18 15:19:30.408437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 414/819] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:30 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:30.697340 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:30.698270 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:30.704889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:30.705386 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:30.706161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:30.706633 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:30.848973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:30.857511 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f8ac5e6d-1f10-4123-9be9-638abe01f535 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.164613 Jul 18 15:19:30.858093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 406/820] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:30 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:31.426482 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:31.427231 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:31.435094 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:31.435574 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:31.436367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:31.436810 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:31.571720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:31.579858 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-46bd2389-821f-4806-8011-a54c16737610 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.157220 Jul 18 15:19:31.580464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 415/821] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:31 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:31.875280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:31.875927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:31.883715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:31.884167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:31.884951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:31.885420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:32.033840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:32.041995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e2ce5673-80ce-4033-bb47-ed6553c3739c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.170609 Jul 18 15:19:32.042610 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 407/822] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:31 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:32.597744 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:32.598368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:32.602020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:32.606866 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:32.607390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:32.608157 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:32.608601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:32.753754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:32.757673 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:32.762002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-79e5a3b3-e6a4-406e-8ab2-45d9c4a5f453 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.168486 Jul 18 15:19:32.762791 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 416/823] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:32 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:33.059316 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:33.059941 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:33.066841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:33.067304 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:33.068214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:33.068662 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:33.207115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:33.215193 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cd987e85-c184-4191-9e79-66e76575fd82 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1318 microversion: 2.1 time: 0.159994 Jul 18 15:19:33.215807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 408/824] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:33 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:33.790799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:33.791467 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:33.798832 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:33.799295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:33.800098 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:33.800538 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:33.944532 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:33.952973 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a7a42bd8-2492-4c20-b671-1d814ceb8164 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1522 microversion: 2.1 time: 0.166746 Jul 18 15:19:33.953561 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 417/825] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:33 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:34.234235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:34.234991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:34.237478 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:34.242515 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.243013 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:34.244015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.244462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:34.393079 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:34.401407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-99557f60-1548-40b8-b71b-66b982cb4189 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1506 microversion: 2.1 time: 0.171742 Jul 18 15:19:34.401984 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 409/826] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:34 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:34.423656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0119b0a8-bc5e-415f-a8bb-3c61c35460a3", "device": "/dev/sdb"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:34.423656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:34.431483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.432910 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:34.433095 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.434008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:34.520272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-6a9a131a-e084-4a8d-9f13-257839658bfd req-1dc11de0-a7ac-4584-a578-6145f51a8b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541110c4-7284-457c-8298-e2235b1cb050", "name": "network-vif-deleted", "tag": "c7f3b156-84e2-45e5-9799-67d28ad1cdd5"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:34.530167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-6a9a131a-e084-4a8d-9f13-257839658bfd req-1dc11de0-a7ac-4584-a578-6145f51a8b0e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.530647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-6a9a131a-e084-4a8d-9f13-257839658bfd req-1dc11de0-a7ac-4584-a578-6145f51a8b0e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:34.543008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-6a9a131a-e084-4a8d-9f13-257839658bfd req-1dc11de0-a7ac-4584-a578-6145f51a8b0e service nova] Creating event network-vif-deleted:c7f3b156-84e2-45e5-9799-67d28ad1cdd5 for instance 541110c4-7284-457c-8298-e2235b1cb050 on hv-cinder-83697 Jul 18 15:19:34.548110 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-6a9a131a-e084-4a8d-9f13-257839658bfd req-1dc11de0-a7ac-4584-a578-6145f51a8b0e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 Jul 18 15:19:34.549041 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 410/827] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:19:34.973565 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:34.974282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:34.983699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.984773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:34.986425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:34.986916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:35.024921 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:35.025388 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:35.025847 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lazy-loading 'fault' on Instance uuid 541110c4-7284-457c-8298-e2235b1cb050 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:19:35.076855 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c869550ee437a8e775e997c741e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e83fff7c7524da9905cdb86ccdb565a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:35.084720 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d8cbb9e5-6204-4b69-b6e1-b1e1e5fb372b tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 200 len: 1312 microversion: 2.1 time: 0.116518 Jul 18 15:19:35.087264 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 411/828] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:34 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:19:35.453026 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fc3d4d2e-0097-41a5-8e2f-c5588dfbfce5 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "POST /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.038709 Jul 18 15:19:35.453694 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 418/829] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:19:34 2022] POST /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:19:36.102437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:36.103334 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] [instance: 541110c4-7284-457c-8298-e2235b1cb050] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:36.110317 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:36.110800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:36.111574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:36.112019 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:36.126742 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] HTTP exception thrown: Instance 541110c4-7284-457c-8298-e2235b1cb050 could not be found. Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Request method failure captured: Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 HTTP/1.1 Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XilQOYHXnhdj8LVhm7yZ74HO2Lcn7vbfHWa-RSIfxRpuNTHr6-zMoophvAWGrAJjebPvYyHYWva1LAM5w9F1HEcJaB67vDQDlBjZEG_w9tq_Qi3149rOCGtxWQp4jBQHRz5XSFm1jGrr9iWAPcw-e-hec50dMNiV7D_ksgh51StYiE Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:19:36.128444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0e83fff7c7524da9905cdb86ccdb565a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0e83fff7c7524da9905cdb86ccdb565a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 0e83fff7c7524da9905cdb86ccdb565a Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1265161477 Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 648c869550ee437a8e775e997c741e58 Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1265161477-project Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 541110c4-7284-457c-8298-e2235b1cb050 could not be found. Jul 18 15:19:36.129887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '541110c4-7284-457c-8298-e2235b1cb050'} Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541110c4-7284-457c-8298-e2235b1cb050 could not be found. Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:19:36.130674 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541110c4-7284-457c-8298-e2235b1cb050 could not be found. Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541110c4-7284-457c-8298-e2235b1cb050 could not be found. Jul 18 15:19:36.131901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:19:36.133031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] Returning 404 to user: Instance 541110c4-7284-457c-8298-e2235b1cb050 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:19:36.133031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7ecdea67-3d2a-46e1-9c12-1550b7c6e156 tempest-ServerRescueNegativeTestJSON-1265161477 tempest-ServerRescueNegativeTestJSON-1265161477-project] 10.222.0.83 "GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050" status: 404 len: 111 microversion: 2.1 time: 0.032082 Jul 18 15:19:36.133031 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 412/830] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:19:36 2022] GET /compute/v2.1/servers/541110c4-7284-457c-8298-e2235b1cb050 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:19:42.406045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:42.406722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:42.413073 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:42.413533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:42.414900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:42.415337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:42.447754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0223bb42-72c3-4d01-88f4-a86986aa5710 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/ips" status: 200 len: 152 microversion: 2.20 time: 0.046291 Jul 18 15:19:42.448873 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 419/831] 10.222.0.83 () {60 vars in 1288 bytes} [Mon Jul 18 15:19:42 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:19:44.871850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:19:44.872483 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:44.879286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:44.879852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:44.880652 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:44.881089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:44.907568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lazy-loading 'flavor' on Instance uuid 2f5c527a-8a3f-408e-b203-3b0be66fc001 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:19:45.552799 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2ad83c32-f28e-45b5-b194-7853a0b4bbd7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/action" status: 202 len: 0 microversion: 2.20 time: 0.686336 Jul 18 15:19:45.559189 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 413/832] 10.222.0.83 () {62 vars in 1318 bytes} [Mon Jul 18 15:19:44 2022] POST /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/action => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:19:45.569162 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:45.570007 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:45.582862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:45.582862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:45.582862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:45.582862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:45.751545 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:45.761574 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:45.763316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:45.764704 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-19c2a525-3b17-404f-9a30-a8ff58b4a801 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.199612 Jul 18 15:19:45.765303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 420/833] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:45 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:46.792908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:46.793980 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:46.805652 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:46.806147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:46.807242 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:46.808008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:46.996091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:47.004395 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:47.005905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:47.007120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dcd5a998-3ece-494c-8e6b-7853ef00492c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.224329 Jul 18 15:19:47.007707 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 414/834] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:46 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:48.027383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:48.028289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:48.035196 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:48.035652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:48.036528 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:48.036964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:48.199726 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:48.210043 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:48.212161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:48.213472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-faca4a1a-b24e-4703-84d4-706537c9cc5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.191244 Jul 18 15:19:48.214133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 421/835] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:48 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:49.236358 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:49.236989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:49.244521 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:49.245013 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:49.245818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:49.246264 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:49.446899 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:49.456517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:49.458189 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:49.459715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-50459d4b-7580-49b8-a860-5a70bfc59e5e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.227562 Jul 18 15:19:49.460308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 415/836] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:49 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:50.484886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:50.484886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:50.492020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:50.493078 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:50.493903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:50.494355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:50.982827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:50.997228 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:51.000340 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:51.002211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b7f3e0c2-d09e-4202-8d14-29f205c22f92 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.522532 Jul 18 15:19:51.003154 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 422/837] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:50 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:52.025848 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:52.026482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:52.033629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:52.034092 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:52.035058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:52.035513 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:52.213187 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:52.217872 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:19:52.224039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:52.227893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:52.227893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e06bafdb-62bd-42e5-acb0-2dffdb41d0f0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.205976 Jul 18 15:19:52.228830 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 416/838] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:52 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:53.250048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:53.251280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:53.259514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:53.259976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:53.260778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:53.261231 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:53.431266 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:53.445978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:53.448099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:53.449875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-01f205ff-f125-4566-b9f7-01f8ec95d47e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.204308 Jul 18 15:19:53.451039 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 423/839] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:53 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:54.475831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:54.477304 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:54.490255 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:54.491015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:54.492364 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:54.493713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:54.689547 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:54.707743 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:54.711695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:54.715705 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a3224cbc-c242-4977-b93f-7217b84d7337 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.247347 Jul 18 15:19:54.717508 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 417/840] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:54 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:55.740776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:55.742781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:55.751958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:55.752770 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:55.754064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:55.754920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:55.927121 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:55.938331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:55.939929 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:55.941492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7e13f037-1e56-465a-9dc2-f3a4d8e3a362 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.207689 Jul 18 15:19:55.942069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 424/841] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:55 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:19:56.924254 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:56.924254 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:56.933012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:56.933486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:56.934297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:56.934980 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:56.963632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:56.964662 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:56.972041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:56.972550 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:56.973220 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:56.973663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:57.043891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lazy-loading 'services' on Instance uuid 21f1e50e-cf63-4feb-be9b-632481fb4806 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:19:57.169069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:57.179199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:57.180897 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:57.182152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b36ffb06-f537-431a-a8dc-1f2b5f061d93 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.224595 Jul 18 15:19:57.182792 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 425/842] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:56 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:19:57.324450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a9d87ff6-c6a4-46dd-a98d-885e0e8a45c4 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "DELETE /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806/os-volume_attachments/0119b0a8-bc5e-415f-a8bb-3c61c35460a3" status: 202 len: 0 microversion: 2.1 time: 0.405334 Jul 18 15:19:57.325064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 418/843] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:19:56 2022] DELETE /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806/os-volume_attachments/0119b0a8-bc5e-415f-a8bb-3c61c35460a3 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:19:58.203046 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:58.209899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:58.211096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:58.212206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:58.212206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:58.212580 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:58.385175 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:58.396329 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:58.398281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:58.400031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-381ebcea-a231-41e9-ad20-179da3c90fb1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.201114 Jul 18 15:19:58.401173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 426/844] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:58 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:59.422287 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:59.423132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:59.430703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:59.431425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:59.432309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:59.432829 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:59.594801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:59.598906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:19:59.599753 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:19:59.607461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:59.608395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:59.609475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:19:59.610176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:19:59.611725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:59.614871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:19:59.617543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a67bc373-da0e-4e3d-89d2-430d7c8f2f9a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.200310 Jul 18 15:19:59.619089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 419/845] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:19:59 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:19:59.640555 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:20:00.033275 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8dbef6a4-0066-4121-a261-486f90cde8c9 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "DELETE /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 204 len: 0 microversion: 2.1 time: 0.450041 Jul 18 15:20:00.034282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 427/846] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:19:59 2022] DELETE /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:20:00.044746 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:00.045333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:00.052283 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:00.052761 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:00.053568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:00.054007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:00.219497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:00.232765 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a3b6280b-c8ea-4a6e-a11d-fc21232f678e tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1512 microversion: 2.1 time: 0.193240 Jul 18 15:20:00.234449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 420/847] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:00 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:00.655495 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:00.656812 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:00.670403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:00.671267 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:00.672757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:00.673665 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:00.878799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:00.893189 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:00.896475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:00.898876 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-65badb62-d79b-4c30-a66e-a6ce253e7be4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.254060 Jul 18 15:20:00.899988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 428/848] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:00 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:01.256196 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:01.256997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:01.260678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:01.262768 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:01.265773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.266322 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.267601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.268356 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.276752 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.277416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.278576 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.279091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.308282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lazy-loading 'flavor' on Instance uuid d4e6cc3f-8715-4d58-8c37-12d2256dc58e {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:20:01.479093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:01.485680 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:01.493570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5f12349c-35cc-4e4a-93e4-c2ecff21959c tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1512 microversion: 2.1 time: 0.241838 Jul 18 15:20:01.494994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 421/849] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:01 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:01.686702 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a90423f9-2b6c-42b7-96c3-46128cd86b02 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "POST /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e/action" status: 202 len: 0 microversion: 2.1 time: 0.434844 Jul 18 15:20:01.688764 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 429/850] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:20:01 2022] POST /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:20:01.703007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:01.704372 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:01.717294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.718221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.719810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.720845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.902266 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:01.911922 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-761b91c6-64dd-4ac8-83d7-4636ddb17f30 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.217231 Jul 18 15:20:01.912661 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 422/851] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:01 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:01.928041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:01.930191 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:01.945833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.946690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:01.947852 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:01.948398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:02.229737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:02.239241 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:02.241172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:02.243190 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-576767a6-16cc-47a5-96fb-eda1aef90899 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.324257 Jul 18 15:20:02.243798 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 430/852] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:01 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:02.524302 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:02.525363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:02.537571 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:02.538264 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:02.546871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:02.547884 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:02.741113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:02.749952 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0228abd5-6796-451c-aa2e-6e988d4fb603 tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1512 microversion: 2.1 time: 0.234563 Jul 18 15:20:02.750564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 423/853] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:02 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:02.865632 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-133b0737-972d-46a3-b606-754874805a47 req-46a45f90-533e-4c97-9ca4-9346b85499dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f1e50e-cf63-4feb-be9b-632481fb4806", "name": "network-vif-deleted", "tag": "551d3000-b6f0-432a-8a8f-f299320d6bf9"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:02.871388 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:02.876971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-133b0737-972d-46a3-b606-754874805a47 req-46a45f90-533e-4c97-9ca4-9346b85499dd service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:02.877418 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-133b0737-972d-46a3-b606-754874805a47 req-46a45f90-533e-4c97-9ca4-9346b85499dd service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:02.889347 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-133b0737-972d-46a3-b606-754874805a47 req-46a45f90-533e-4c97-9ca4-9346b85499dd service nova] Creating event network-vif-deleted:551d3000-b6f0-432a-8a8f-f299320d6bf9 for instance 21f1e50e-cf63-4feb-be9b-632481fb4806 on hv-cinder-83697 Jul 18 15:20:02.894224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-133b0737-972d-46a3-b606-754874805a47 req-46a45f90-533e-4c97-9ca4-9346b85499dd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Jul 18 15:20:02.894881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 431/854] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:02.932991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:02.933722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:02.940248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:02.940699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:02.941476 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:02.941911 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:03.268909 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:03.270740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:03.289672 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:03.290290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:03.291434 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:03.291900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:03.485394 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:03.496037 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:03.497933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:03.508483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-747cfed6-ce9f-497f-87d0-b3a9a691baa7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.239140 Jul 18 15:20:03.508483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 432/855] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:03 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:03.516918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:03.525859 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2994bed8-c5f1-4509-a74b-849686eea7bf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.599398 Jul 18 15:20:03.536174 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 424/856] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:02 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:03.773676 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:03.775225 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:03.784960 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:03.785899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:03.787725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:03.788362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:03.826573 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:03.827458 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:03.828226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lazy-loading 'fault' on Instance uuid 21f1e50e-cf63-4feb-be9b-632481fb4806 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:20:03.890409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4746f061cfd148609ffaf568f869d6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd59138153e461bb239770cc1bbc1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:03.902400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-039a49b1-5d5a-41cc-a176-84d91aa6ffbf tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 200 len: 1308 microversion: 2.1 time: 0.137727 Jul 18 15:20:03.903048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 433/857] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:03 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:04.518758 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:04.519383 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:04.527003 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:04.527734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:04.528256 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:04.528696 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:04.546427 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:04.548171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:04.556444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:04.556898 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:04.557931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:04.558373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:04.711087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:04.720725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-32bb93b6-7110-4000-acb1-cbdfaae63a4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.178591 Jul 18 15:20:04.721801 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 434/858] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:04 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:04.827195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:04.837125 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:04.838705 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:04.840306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-54544898-8533-45ad-ad4c-f0e35e0425af tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1744 microversion: 2.20 time: 0.325570 Jul 18 15:20:04.840916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 425/859] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:04 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1744 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:04.926210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:04.926210 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] [instance: 21f1e50e-cf63-4feb-be9b-632481fb4806] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:04.931787 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:04.932251 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:04.933058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:04.933512 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:04.948755 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] HTTP exception thrown: Instance 21f1e50e-cf63-4feb-be9b-632481fb4806 could not be found. Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Request method failure captured: Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 HTTP/1.1 Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XmCGlCjY0t_18JBjAa1KOuNbX110EvXhrL6B3jfCesnOy7g2L2ZrACZbrDXDCp60CwDv_CrM5Ft8j164wa9JnfIJJK25Geu-ar-krHI4wItgJzfrxqimpx4syYA_qyE8HlEg-YFxJ9b5iDyrkwkgCZkAs80qlurIt-uJSR9wwKAAsY Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: fcd59138153e461bb239770cc1bbc1f1 Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1331677335 Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:20:04.950465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fcd59138153e461bb239770cc1bbc1f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fcd59138153e461bb239770cc1bbc1f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fcd59138153e461bb239770cc1bbc1f1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fcd59138153e461bb239770cc1bbc1f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotTestJSON-1331677335 Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: fcd59138153e461bb239770cc1bbc1f1 Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1331677335 Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotTestJSON-1331677335-project Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 4746f061cfd148609ffaf568f869d6d8 Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotTestJSON-1331677335-project Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 21f1e50e-cf63-4feb-be9b-632481fb4806 could not be found. Jul 18 15:20:04.952040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '21f1e50e-cf63-4feb-be9b-632481fb4806'} Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f1e50e-cf63-4feb-be9b-632481fb4806 could not be found. Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:20:04.952945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f1e50e-cf63-4feb-be9b-632481fb4806 could not be found. Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f1e50e-cf63-4feb-be9b-632481fb4806 could not be found. Jul 18 15:20:04.956963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:20:04.959993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] Returning 404 to user: Instance 21f1e50e-cf63-4feb-be9b-632481fb4806 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:20:04.959993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-64e223a0-7797-45e0-86ea-d53a2ced8b9b tempest-VolumesSnapshotTestJSON-1331677335 tempest-VolumesSnapshotTestJSON-1331677335-project] 10.222.0.83 "GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806" status: 404 len: 111 microversion: 2.1 time: 0.032080 Jul 18 15:20:04.959993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 435/860] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:04 2022] GET /compute/v2.1/servers/21f1e50e-cf63-4feb-be9b-632481fb4806 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:20:05.740132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:05.741811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:05.744698 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=36 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:05.750091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:05.750840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:05.751642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:05.752081 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:05.862068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:05.863162 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:05.871199 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:05.872544 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:05.872882 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:05.873431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:05.899860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:05.909517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f7854545-cf6c-48c1-b0c4-219817707d2c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.173321 Jul 18 15:20:05.910218 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 426/861] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:05 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:06.017117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:06.026226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:06.027820 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:06.029018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b55c4338-e483-414d-a256-d600802688a7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1744 microversion: 2.20 time: 0.172150 Jul 18 15:20:06.029655 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 436/862] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:05 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:06.980326 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:06.983219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:06.998854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:07.001449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:07.005000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:07.006128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:07.049166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:07.050596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:07.059543 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:07.060262 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:07.061316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:07.062091 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:07.214482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:07.237996 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-91a2db30-1891-4288-9b30-e66330b76ac2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.263634 Jul 18 15:20:07.239228 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 427/863] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:06 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:07.285374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:07.301430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:07.305974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:07.307674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d0ab98e7-92e0-45eb-a09f-10fc37c71e36 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.263149 Jul 18 15:20:07.308525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 437/864] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:07 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:07.711213 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-4c2e9bed-8243-4f6f-8985-187f2fa76a80 req-28d282a8-73d1-4904-bd98-7f970a9b7c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "name": "network-vif-plugged", "status": "completed", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:07.736845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-4c2e9bed-8243-4f6f-8985-187f2fa76a80 req-28d282a8-73d1-4904-bd98-7f970a9b7c17 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:07.741667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-4c2e9bed-8243-4f6f-8985-187f2fa76a80 req-28d282a8-73d1-4904-bd98-7f970a9b7c17 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:07.755972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-4c2e9bed-8243-4f6f-8985-187f2fa76a80 req-28d282a8-73d1-4904-bd98-7f970a9b7c17 service nova] Creating event network-vif-plugged:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:20:07.764754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-4c2e9bed-8243-4f6f-8985-187f2fa76a80 req-28d282a8-73d1-4904-bd98-7f970a9b7c17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057859 Jul 18 15:20:07.766708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 428/865] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:08.269882 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:08.274958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:08.283309 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:08.284389 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:08.285613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:08.286238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:08.337673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:08.338294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:08.347087 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:08.347942 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:08.349030 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:08.349726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:08.486372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:08.497004 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2c344fef-ce46-4f5f-a283-79dbd7dc61a6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.231683 Jul 18 15:20:08.500236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 438/866] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:08 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:08.624430 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:08.641272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:08.647463 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:08.647463 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-81106dd8-eb99-4842-a7aa-298ae8e6cb5f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.317145 Jul 18 15:20:08.659168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 429/867] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:08 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:09.194684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:09.196106 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:09.203374 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:09.204799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:09.205847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:09.206517 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:09.254576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8b8c6873-76cb-47e4-8367-280abe2c0c1b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/ips" status: 200 len: 146 microversion: 2.1 time: 0.064539 Jul 18 15:20:09.262259 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 439/868] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:20:09 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/ips => generated 146 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:09.517959 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:09.518773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:09.526363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:09.526841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:09.527886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:09.528334 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:09.673295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:09.674622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:09.692273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:09.693148 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:09.694405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:09.696736 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:09.745997 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:09.764229 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ac8cc4e9-207b-4751-a383-f917d497f5bd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.249752 Jul 18 15:20:09.765504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 430/869] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:09 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:10.001783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:10.024562 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:10.027226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:10.029004 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9c382229-2bb2-4ab2-840e-5359dcc9c680 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.365709 Jul 18 15:20:10.030003 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 440/870] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:09 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:10.789533 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:10.790207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:10.797127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:10.797533 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:10.798329 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:10.798802 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:10.957501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:10.968024 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3a589b82-fa15-4472-a725-002def456c67 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.182524 Jul 18 15:20:10.968811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 431/871] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:10 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:11.048782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:11.049423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:11.057269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:11.059761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:11.059761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:11.059761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:11.233991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0844ce30-a773-4f7c-8ac9-4c8c206ee2f1"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:11.236568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:11.253394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:11.253862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:11.254883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:11.255381 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:11.281087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:11.292459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:11.294090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:11.295344 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8a09b6c4-1926-4f2f-9c03-025c70b5dac4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.250834 Jul 18 15:20:11.295923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 441/872] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:11 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:11.992060 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:11.993494 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:12.002625 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:12.012596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:12.012596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:12.012596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:12.039121 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:12.210340 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:12.222158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-71a26ccc-d874-406f-914e-b954252f2e46 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991798 Jul 18 15:20:12.223272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 432/873] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:20:11 2022] POST /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:12.225370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7a880d4e-cba1-4149-bd87-15ac99e5bfb6 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.240894 Jul 18 15:20:12.227463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 442/874] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:11 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:12.320282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:12.321028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:12.338315 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:12.338827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:12.339660 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:12.340113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:12.563819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:12.576390 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:12.578437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:12.579689 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-88c17281-ad9e-446e-a45c-070ff80e8615 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.265021 Jul 18 15:20:12.580267 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 433/875] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:12 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:13.248346 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:13.249686 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:13.273615 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:13.274131 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:13.275585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:13.275585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:13.556858 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:13.576401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fadf7772-fd7e-4bc8-8ea1-f09894a65c81 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.335297 Jul 18 15:20:13.577527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 443/876] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:13 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:13.602037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:13.605500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:13.610653 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:13.611120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:13.612131 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:13.612586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:13.792412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:13.803857 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:13.805928 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:13.807203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-53975a1d-aaf0-4845-b427-bfe40de75758 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.211009 Jul 18 15:20:13.807961 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 434/877] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:13 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:14.601639 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:14.602622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:14.609867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:14.610328 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:14.611166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:14.611613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:14.763002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:14.771264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-13e91a86-bdbb-4c59-9a42-210d5d55216f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.179681 Jul 18 15:20:14.772037 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 444/878] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:14 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:14.826567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:14.827282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:14.834262 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:14.834770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:14.836326 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:14.836848 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:15.033640 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:15.044534 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:15.046260 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:15.048500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e6cf0568-94c3-420d-be4a-840522b0e5e0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.226141 Jul 18 15:20:15.049762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 435/879] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:14 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:15.793855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:15.795594 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:15.810816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:15.811732 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:15.813085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:15.815069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:16.046415 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:16.060413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-975b0b4f-26ce-4db5-8e03-e9bbddaeaf66 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.272671 Jul 18 15:20:16.062363 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 445/880] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:15 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:16.074147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:16.075900 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:16.084520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:16.085983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:16.087648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:16.088574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:16.614442 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:16.629490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:16.645630 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:16.652667 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6011fde8-62c5-4f31-b15a-33c949c3e1b2 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.578760 Jul 18 15:20:16.655078 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 436/881] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:16 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:17.100659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:17.100659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:17.122851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:17.123300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:17.132660 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:17.133487 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:17.452178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:17.456400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:17.467906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f3d0af24-0eb1-4337-b3e1-a32a259a469b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.378116 Jul 18 15:20:17.479644 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 446/882] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:17 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:17.678230 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:17.680296 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:17.693346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:17.694160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:17.696344 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:17.696995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:17.949756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:17.963465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:17.966527 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:17.968256 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c5a370f9-c4a4-4f43-b058-77380a482f42 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.296994 Jul 18 15:20:17.969419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 437/883] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:17 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:18.489388 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:18.490048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:18.498636 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:18.499286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:18.500086 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:18.500529 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:18.843743 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:18.852965 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4a307314-6777-41ec-8b72-6e8ec744fd5d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.368227 Jul 18 15:20:18.853876 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 447/884] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:18 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:18.995837 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:18.996683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:19.004640 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:19.004978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:19.005796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:19.006263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:19.170427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:19.181214 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:19.182803 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:19.184180 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ea012afd-71a7-47cb-9e8e-fd9c5ad0433d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.192959 Jul 18 15:20:19.184797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 438/885] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:18 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:19.872403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:19.873720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:19.885498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:19.886286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:19.887716 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:19.889067 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:20.067771 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:20.076956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5eef5dac-e3a0-49bd-94e1-0f521e25386b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.209464 Jul 18 15:20:20.077704 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 448/886] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:19 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:20.203990 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:20.204682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:20.212470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:20.212918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:20.213717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:20.214155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:20.373138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:20.389972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:20.389972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:20.389972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8056b481-55a9-469b-ae5e-82707584c2ea tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1739 microversion: 2.20 time: 0.187086 Jul 18 15:20:20.390683 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 439/887] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:20 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:21.097988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:21.099020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:21.106382 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:21.106877 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:21.107688 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:21.108135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:21.289608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:21.302136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-547ffae6-8b44-4e64-99e3-c3db5642973d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.207767 Jul 18 15:20:21.302781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 449/888] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:21 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:21.408183 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:21.408844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:21.417318 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:21.417817 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:21.418761 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:21.419222 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:21.586416 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:21.597427 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:21.599000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:21.603647 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3d9e02c6-54d3-4eb1-ac0b-838d539f914e tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1721 microversion: 2.20 time: 0.199434 Jul 18 15:20:21.604241 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 440/889] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:21 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:22.323032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:22.323773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:22.331461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:22.331823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:22.332620 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:22.333100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:22.489691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:22.498594 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bb4e460d-ecc1-4e7c-a75e-96dd486877d3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.179558 Jul 18 15:20:22.499243 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 450/890] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:22 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:22.635993 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:22.636591 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:22.644810 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:22.645264 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:22.648672 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:22.648672 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:22.810392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:22.821105 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:22.823003 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:22.825937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cd47d003-0215-4559-adbd-b7e4064a9d81 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1721 microversion: 2.20 time: 0.194272 Jul 18 15:20:22.842205 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 441/891] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:22 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:23.517061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:23.517808 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:23.544531 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.546918 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:23.547964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:23.549140 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.550172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.550837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.558820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.560089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.562807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.563584 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.631499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-85999726-34d1-4b9a-8a1b-2da41f9efe2b tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091519 Jul 18 15:20:23.632144 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 442/892] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:20:23 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:23.644389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:23.645090 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:23.653236 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.661473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.661473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.661473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.687602 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-65687b00-fcf3-421f-a94e-e9329e2f4079 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/0844ce30-a773-4f7c-8ac9-4c8c206ee2f1" status: 200 len: 194 microversion: 2.1 time: 0.047515 Jul 18 15:20:23.689406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 443/893] 10.222.0.83 () {58 vars in 1412 bytes} [Mon Jul 18 15:20:23 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/0844ce30-a773-4f7c-8ac9-4c8c206ee2f1 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:23.757621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:23.773874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5aabf0cc-0efd-4de1-8deb-b938df4ab7de tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.260764 Jul 18 15:20:23.774768 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 451/894] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:23 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:23.852195 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:23.853373 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:23.861307 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.862077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:23.863151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:23.864150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:24.054604 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:24.066069 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:24.067522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:24.068955 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-51480f9d-27b6-4d32-b177-31ece4f43748 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1721 microversion: 2.20 time: 0.221639 Jul 18 15:20:24.070353 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 444/895] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:23 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:24.793066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:24.793726 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:24.800286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:24.800740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:24.801518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:24.801962 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:24.952631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:24.965453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1b136f1e-0f1a-4daf-b02e-f516b9f79d8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.176586 Jul 18 15:20:24.966153 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 452/896] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:24 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:25.092774 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:25.094857 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:25.107551 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:25.108608 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:25.109919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:25.110699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:25.287504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:25.298862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:25.300728 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:25.301990 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a19a16ae-9665-4ba8-89c3-005d9cbb6571 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1721 microversion: 2.20 time: 0.216631 Jul 18 15:20:25.302607 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 445/897] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:25 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:25.637264 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-32c1d83f-d926-46d5-9dba-bb9bbd6b4b9f req-e51f8fd4-f7ba-4917-aa5e-f8ecd18e1344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "name": "network-vif-unplugged", "status": "completed", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:25.645857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-32c1d83f-d926-46d5-9dba-bb9bbd6b4b9f req-e51f8fd4-f7ba-4917-aa5e-f8ecd18e1344 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:25.646310 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-32c1d83f-d926-46d5-9dba-bb9bbd6b4b9f req-e51f8fd4-f7ba-4917-aa5e-f8ecd18e1344 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:25.661271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-32c1d83f-d926-46d5-9dba-bb9bbd6b4b9f req-e51f8fd4-f7ba-4917-aa5e-f8ecd18e1344 service nova] Creating event network-vif-unplugged:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:20:25.667640 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-32c1d83f-d926-46d5-9dba-bb9bbd6b4b9f req-e51f8fd4-f7ba-4917-aa5e-f8ecd18e1344 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034531 Jul 18 15:20:25.668266 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 453/898] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:25.754433 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec13588e-72e6-4873-8599-1009136b6fe9"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:25.755634 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:25.765524 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:25.765988 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:25.766854 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:25.767398 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:25.993815 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:25.994530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:26.001330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.001860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.002704 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.003150 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.163481 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:26.181402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e030f80b-938b-4288-bb72-f1fdd87e941d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1568 microversion: 2.1 time: 0.184506 Jul 18 15:20:26.183304 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 454/899] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:25 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:26.193674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:26.195928 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:26.203634 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.204431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.205515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.206195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.532572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb64fe18-92e6-44b9-91c5-9eb182a5527e tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "POST /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e/action" status: 202 len: 0 microversion: 2.1 time: 0.344031 Jul 18 15:20:26.536255 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 455/900] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Jul 18 15:20:26 2022] POST /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 15:20:26.543076 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:26.543966 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:26.551438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.552025 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.553120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.554222 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.690090 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:26.698298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:26.699999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:26.701392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-22d671db-9971-4c86-8fd1-9cf8de5bb229 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1664 microversion: 2.20 time: 0.166671 Jul 18 15:20:26.702139 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 456/901] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:26 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:26.706912 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:26.707807 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:26.714955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.715979 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.716973 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.717629 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.918723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:26.927223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a0856075-5f78-4cfa-8d4f-09d2874080a3 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1516 microversion: 2.1 time: 0.223732 Jul 18 15:20:26.927779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 457/902] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:26 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:26.934395 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b41fc3bb-35dd-40a8-9eb4-f70a7fd2610f"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:26.935116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:26.941712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.942187 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.943020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:26.943483 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:26.952550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f9305c02-0765-477a-ad12-d8a82ce003aa tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "POST /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.201907 Jul 18 15:20:26.953731 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 446/903] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:20:25 2022] POST /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments => generated 194 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:27.684561 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-95638e98-5eb7-4c03-88dd-e7a0b2f8b9aa req-c9f62ec3-85d7-42ca-828a-66094bc4ae4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "name": "network-vif-unplugged", "status": "completed", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:27.698018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-95638e98-5eb7-4c03-88dd-e7a0b2f8b9aa req-c9f62ec3-85d7-42ca-828a-66094bc4ae4c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:27.699356 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-95638e98-5eb7-4c03-88dd-e7a0b2f8b9aa req-c9f62ec3-85d7-42ca-828a-66094bc4ae4c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:27.713892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.compute.server_external_events [req-95638e98-5eb7-4c03-88dd-e7a0b2f8b9aa req-c9f62ec3-85d7-42ca-828a-66094bc4ae4c service nova] Unable to find a host for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e. Dropping event network-vif-unplugged {{(pid=118339) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 15:20:27.715092 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-95638e98-5eb7-4c03-88dd-e7a0b2f8b9aa req-c9f62ec3-85d7-42ca-828a-66094bc4ae4c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035349 Jul 18 15:20:27.715696 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 447/904] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 15:20:27.956324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:27.956324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:27.956324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:27.956324 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:27.957127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:27.957127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:27.973184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:28.137487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:28.148178 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-af0b450f-2b00-4f1d-87ed-5de12dc92e57 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1516 microversion: 2.1 time: 0.206677 Jul 18 15:20:28.149250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 448/905] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:27 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:29.171147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:29.171954 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:29.180831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:29.181278 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:29.182200 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:29.182742 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:29.340518 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:29.349070 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0a38699c-91ef-4de8-ad60-8c541f384ce4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.184773 Jul 18 15:20:29.349654 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 449/906] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:29 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:29.378908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0eb437c2-12f5-4fbd-b9b7-48da08ab9422 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.449656 Jul 18 15:20:29.379908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 458/907] 10.222.0.83 () {62 vars in 1363 bytes} [Mon Jul 18 15:20:26 2022] POST /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-volume_attachments => generated 188 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 15:20:29.505392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:29.505908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:29.516155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:29.516618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:29.517417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:29.517864 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.121687 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c1122116-c07a-4176-a1a8-f2c305d29eec tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-volume_attachments/b41fc3bb-35dd-40a8-9eb4-f70a7fd2610f" status: 202 len: 0 microversion: 2.20 time: 0.620548 Jul 18 15:20:30.122215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 450/908] 10.222.0.83 () {60 vars in 1456 bytes} [Mon Jul 18 15:20:29 2022] DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-volume_attachments/b41fc3bb-35dd-40a8-9eb4-f70a7fd2610f => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:20:30.190095 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:30.190776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:30.198891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:30.199343 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.200138 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:30.200574 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.261200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:30.367628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:30.368263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:30.375876 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:30.375876 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.376265 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:30.376705 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.464286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-36dceb02-0a6a-42fe-91a8-bbafdc52b767 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "POST /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/action" status: 202 len: 0 microversion: 2.20 time: 0.279301 Jul 18 15:20:30.465239 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 459/909] 10.222.0.83 () {62 vars in 1318 bytes} [Mon Jul 18 15:20:30 2022] POST /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:20:30.474990 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:30.475901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:30.484045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:30.484794 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.485590 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:30.486215 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:30.521009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:30.529880 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-20104f17-9102-483b-a94b-7736617acb80 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.166745 Jul 18 15:20:30.530666 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 451/910] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:30 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:30.635696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:30.643910 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:30.645893 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:30.647681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0015aaa5-51f1-44e2-b522-2ec186a1e7f6 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1672 microversion: 2.20 time: 0.176691 Jul 18 15:20:30.648195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 460/911] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:30 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:31.550814 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:31.551405 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:31.559071 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:31.559531 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:31.560322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:31.560762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:31.665714 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:31.674733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:31.681708 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:31.682204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:31.683061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:31.683510 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:31.704504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:31.713425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-41c591da-baac-4804-bbaa-d35138c5fefd tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.167952 Jul 18 15:20:31.714194 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 452/912] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:31 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:31.824274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:31.832730 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:31.834277 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:31.836474 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-902e95d9-93fa-4121-b26e-35768c76565b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1672 microversion: 2.20 time: 0.174934 Jul 18 15:20:31.837079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 461/913] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:31 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:32.734808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:32.734808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:32.741972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:32.742472 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:32.743321 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:32.743767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:32.862124 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:32.863457 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:32.875847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:32.877224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:32.878354 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:32.879173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:32.911924 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:32.921679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-12c0e575-38a5-4a25-956e-56cae3a5ba8b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.192981 Jul 18 15:20:32.939094 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 453/914] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:32 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:33.036273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:33.044769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:33.046301 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:33.047528 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-de543796-b2ab-4b57-a326-79ea8d25b990 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1674 microversion: 2.20 time: 0.193092 Jul 18 15:20:33.048109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 462/915] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:32 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:33.940149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:33.940775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:33.947949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:33.948449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:33.949230 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:33.949666 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:34.067365 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:34.068722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:34.071311 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=70 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:34.091331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:34.107250 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:34.110849 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:34.111942 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:34.112412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:34.116520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-24d0f709-7bc3-4cc9-8e18-dd6f755d355f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.180369 Jul 18 15:20:34.118592 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 454/916] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:33 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:34.352788 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:34.361159 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:34.362766 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:34.364015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f297b827-5168-4332-bbde-0fe9a124c666 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.300919 Jul 18 15:20:34.364592 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 463/917] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:34 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:34.912077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:34.913083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:34.920874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:34.921474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:34.922140 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:34.922618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:34.954146 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-11b87691-e9b1-4a92-83ed-c671310b2469 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046155 Jul 18 15:20:34.954800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 455/918] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:20:34 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:35.134685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:35.135275 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:35.142967 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.143378 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.146657 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.146657 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.155249 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:35.155926 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:35.162387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.162893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.163690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.164813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.200337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ed64737f-4bf4-46cb-b721-65df8a7b1100 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/0844ce30-a773-4f7c-8ac9-4c8c206ee2f1" status: 200 len: 194 microversion: 2.1 time: 0.047354 Jul 18 15:20:35.200337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 456/919] 10.222.0.83 () {58 vars in 1412 bytes} [Mon Jul 18 15:20:35 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/0844ce30-a773-4f7c-8ac9-4c8c206ee2f1 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:35.208374 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:35.208881 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:35.215479 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.215931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.216732 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.217169 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.292031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:35.300320 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-60842f42-6081-43c4-9db2-34de503205ff tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.169868 Jul 18 15:20:35.300911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 464/920] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:35 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:35.309369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lazy-loading 'services' on Instance uuid a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:20:35.382426 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:35.383406 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:35.389914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.390293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.391123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:35.391577 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:35.540903 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:35.553514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:35.555956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:35.557158 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4506f04c-6564-4cbe-ba79-0b2ee23ea8d7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.178677 Jul 18 15:20:35.557751 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 465/921] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:35 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:35.585412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4151dbb0-64bc-488a-8543-60fb2a114068 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/0844ce30-a773-4f7c-8ac9-4c8c206ee2f1" status: 202 len: 0 microversion: 2.1 time: 0.380843 Jul 18 15:20:35.586402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 457/922] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:20:35 2022] DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/0844ce30-a773-4f7c-8ac9-4c8c206ee2f1 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 15:20:36.317653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:36.318509 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:36.326214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:36.332521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:36.332521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:36.332521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:36.467362 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:36.478013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-77a6b2d6-79f0-4e23-8dd7-5a3babd6d8ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.164072 Jul 18 15:20:36.479119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 466/923] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:36 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:36.577059 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:36.577690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:36.585266 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:36.585826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:36.586806 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:36.587167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:36.730049 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:36.738138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:36.739695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:36.740859 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7986e85a-e273-4c01-8d79-c14dd84ae7f3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.168358 Jul 18 15:20:36.741417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 458/924] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:36 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:37.497281 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:37.497880 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:37.504965 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:37.505423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:37.506227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:37.506703 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:37.771445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:37.772368 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:37.776140 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=66 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:37.791221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:37.791862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:37.792862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:37.793309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:37.804156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:37.815859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-67defa34-fad4-480f-b37c-d2e94c4ffbd2 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.323798 Jul 18 15:20:37.816588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 467/925] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:37 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:37.949838 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:37.952588 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:37.954120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:37.955425 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c87b2652-ea44-4fe5-b393-dea49ef88f5c tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.197938 Jul 18 15:20:37.960333 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 459/926] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:37 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:38.835471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:38.837664 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:38.852455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:38.852455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:38.852455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:38.853263 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:38.974974 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:38.977874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:38.986132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:38.988128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:38.989826 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:38.990621 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:39.153279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:39.153279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4d9b8e22-ae56-4a2c-b76c-5f045e8b3a49 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.321594 Jul 18 15:20:39.153279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 468/927] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:38 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:39.164628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:39.174322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:39.178623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:39.178623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-70f4b6bb-c704-44ea-8978-d30ce0004595 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.207835 Jul 18 15:20:39.178623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 460/928] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:38 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:40.169818 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:40.170458 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:40.178117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:40.178892 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:40.180535 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:40.181317 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:40.197892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:40.198739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:40.212603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:40.213420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:40.214391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:40.223890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:40.409587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:40.423651 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bf0a6a3d-9aea-44c5-a1a0-4bec4b780e24 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.257487 Jul 18 15:20:40.425717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 469/929] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:40 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:40.450569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:40.454412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:40.460165 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:40.461754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:40.463011 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-99e1be90-8d25-4412-bbd6-0927dca80f3d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.270593 Jul 18 15:20:40.463599 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 461/930] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:40 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:41.443781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:41.444455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:41.451887 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:41.452346 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:41.453156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:41.453606 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:41.483790 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:41.484490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:41.504632 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:41.505089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:41.505976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:41.506412 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:41.698001 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:41.708227 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:41.715812 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:41.717047 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-682ebe40-ab77-4327-a0d4-8d13cd0a7152 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.237679 Jul 18 15:20:41.718206 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 462/931] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:41 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:41.725998 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:41.754355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab271349-1dcb-4b5f-ae15-46287163b5a7 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.315354 Jul 18 15:20:41.755454 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 470/932] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:41 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:42.738201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:42.739573 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:42.747344 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:42.748104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:42.749077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:42.749692 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:42.774487 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:42.775152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:42.782018 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:42.782928 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:42.784507 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:42.785120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:42.911348 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:42.920853 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:42.925680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:42.925680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-aa646bd1-68df-4a77-ac55-3f268fa04c4d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.190173 Jul 18 15:20:42.925680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 463/933] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:42 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:42.946873 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:42.955473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c2604bfa-940c-4ab6-b621-55389ff62d98 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.186440 Jul 18 15:20:42.956098 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 471/934] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:42 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:43.945160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:43.947616 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:43.955859 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:43.956423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:43.957369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:43.958024 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:43.973532 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:43.974291 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:43.982265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:43.982757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:43.983549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:43.984245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:44.156609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:44.156609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:44.158050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:44.159345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8c081086-6160-4a27-bc68-385d923084a1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.219433 Jul 18 15:20:44.159924 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 464/935] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:43 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:44.180111 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:44.189919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1d55c906-eeaf-41df-89cf-769922439baa tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.220397 Jul 18 15:20:44.191217 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 472/936] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:43 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:45.191327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:45.191957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:45.201534 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:45.202392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:45.203584 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:45.204132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:45.207793 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:45.208410 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:45.227631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:45.245945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:45.245945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:45.245945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:45.390239 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:45.400564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:45.402759 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:45.404276 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-42f9abaf-524d-4efa-b2d0-41929f651267 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.217432 Jul 18 15:20:45.405445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 465/937] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:45 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:45.426051 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:45.438649 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8f516865-3177-4f36-b489-68d8352e4359 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.234667 Jul 18 15:20:45.439469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 473/938] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:45 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:46.423878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:46.424519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:46.444715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:46.445840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:46.446677 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:46.447114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:46.456554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:46.457140 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:46.471472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:46.472166 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:46.473286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:46.473892 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:46.639611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:46.650394 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:46.654073 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:46.655762 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c6c96dd2-f9c8-4a11-bbfe-5d741a2676c1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.235840 Jul 18 15:20:46.669746 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 466/939] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:46 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:46.689596 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:46.701033 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8947c97b-17ad-4089-af49-e98ee7b2d252 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.248081 Jul 18 15:20:46.702022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 474/940] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:46 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:47.677378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:47.678086 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:47.685487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:47.685945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:47.686794 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:47.687243 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:47.723376 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:47.725072 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:47.741276 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:47.741751 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:47.749875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:47.750331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:47.941159 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:47.951710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:47.954055 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:47.957185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-181ef693-fed8-4bac-8f89-80e840d2fbc4 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.282967 Jul 18 15:20:47.971504 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 467/941] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:47 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:48.040222 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:48.049399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-680503dd-f9fc-4e84-aa0b-90a41a90bb6f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.332340 Jul 18 15:20:48.050473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 475/942] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:47 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:48.978807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:48.979465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:48.986601 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:48.987077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:48.988102 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:48.988551 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:49.067893 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:49.068546 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:49.075752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:49.076218 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:49.076992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:49.077431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:49.081979 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:49.132614 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:49.141108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:49.142706 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:49.143994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-597f85bd-5625-4a42-b27e-ba135494a7f5 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.169918 Jul 18 15:20:49.144567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 468/943] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:48 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:49.223000 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:49.231550 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9e0cfe81-7879-4d18-9c1b-f231d6e992a9 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1518 microversion: 2.1 time: 0.167713 Jul 18 15:20:49.232120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 476/944] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:49 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:50.163160 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:50.164363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:50.171719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.172167 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.172948 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.173385 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.250293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:50.251198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:50.259096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.259657 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.260559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.261231 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.334517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:50.344220 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:50.345909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:50.347408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-670ac54f-c236-42b6-a6f2-4a725b4bf7cf tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.188354 Jul 18 15:20:50.347992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 469/945] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:50 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:50.457236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:50.466433 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1f9a9eab-a139-44e0-bd28-6f09f6d1541c tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.220280 Jul 18 15:20:50.467105 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 477/946] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:50 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:50.803503 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:50.804000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:50.811550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.811809 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.812603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.813065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.850415 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1444391d-3941-4d19-9f44-a68d0d02b2bd tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/ec13588e-72e6-4873-8599-1009136b6fe9" status: 200 len: 194 microversion: 2.1 time: 0.050858 Jul 18 15:20:50.854748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 470/947] 10.222.0.83 () {58 vars in 1412 bytes} [Mon Jul 18 15:20:50 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/ec13588e-72e6-4873-8599-1009136b6fe9 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:20:50.863008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:50.864272 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:50.871640 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.872255 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.873328 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:50.873930 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:50.990916 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lazy-loading 'services' on Instance uuid a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:20:51.369272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:51.370631 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:51.375379 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d924efaf-290b-4a67-8dd9-13f2b0b45e01 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/ec13588e-72e6-4873-8599-1009136b6fe9" status: 202 len: 0 microversion: 2.1 time: 0.516213 Jul 18 15:20:51.381467 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 478/948] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:20:50 2022] DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments/ec13588e-72e6-4873-8599-1009136b6fe9 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:20:51.381734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:51.381734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:51.381734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:51.381734 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:51.485226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:51.486105 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:51.492755 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:51.493290 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:51.494162 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:51.494724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:51.540480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:51.550083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:51.552033 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:51.553518 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b1df7b36-8f1d-4e39-9a1a-aa6d7b9ee206 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.189993 Jul 18 15:20:51.565428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 471/949] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:51 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:51.674000 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:51.683426 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-650d78ad-633e-44f2-b06e-09b45cb8e980 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.202291 Jul 18 15:20:51.684247 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 479/950] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:51 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:52.552384 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:52.553384 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:52.560637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.563175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.563175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.563175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.573368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:52.574001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:52.580911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.581366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.582156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.582843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.594097 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3a1a7748-c37d-414d-bd66-d8182ae633b8 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045665 Jul 18 15:20:52.600051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 472/951] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:20:52 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:20:52.702171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:52.703272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:52.712486 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.713309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.714226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.714785 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.753141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:52.763308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:52.765004 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:52.767232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-929b6e75-9514-4136-b218-b6896fe77291 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.198251 Jul 18 15:20:52.768405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 480/952] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:52 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:52.776639 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:52.778392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:52.787031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.787394 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.788213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.788658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.832721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-835abbc9-6cd9-4164-b373-69e5928666b1 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062925 Jul 18 15:20:52.833751 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 481/953] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:20:52 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:20:52.913539 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:52.914065 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:52.916521 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:52.920831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.927061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.927061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:52.927061 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:52.933820 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-55a75cb6-b3dc-4e42-9f36-191414c0f7c4 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.235571 Jul 18 15:20:52.943680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 473/954] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:52 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:52.952308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:20:53.021289 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-b64b86c0-5515-4961-b8d4-b55931af78df req-b94ec014-262c-40a6-948e-500e055b65b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "name": "network-vif-plugged", "status": "completed", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:53.030345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-b64b86c0-5515-4961-b8d4-b55931af78df req-b94ec014-262c-40a6-948e-500e055b65b8 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.030853 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-b64b86c0-5515-4961-b8d4-b55931af78df req-b94ec014-262c-40a6-948e-500e055b65b8 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:53.042865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-b64b86c0-5515-4961-b8d4-b55931af78df req-b94ec014-262c-40a6-948e-500e055b65b8 service nova] Creating event network-vif-plugged:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:20:53.047894 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-b64b86c0-5515-4961-b8d4-b55931af78df req-b94ec014-262c-40a6-948e-500e055b65b8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030391 Jul 18 15:20:53.048497 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 474/955] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:20:53.335782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ad55b0d8-3075-4e97-a42d-a7baf1e5ee17 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 204 len: 0 microversion: 2.1 time: 0.425843 Jul 18 15:20:53.336425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 482/956] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:20:52 2022] DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 15:20:53.345785 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:53.346887 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:53.354313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.354772 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:53.355567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.356009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:53.499901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:53.507843 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fd50bc95-2903-4c5a-a5c0-70e4e83ebec5 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1674 microversion: 2.1 time: 0.166491 Jul 18 15:20:53.508983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 475/957] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:53 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:53.796793 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:53.797491 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:53.804309 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.804773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:53.806212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.806766 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:53.942097 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:53.952083 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:53.952665 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:53.952811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:53.953720 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:53.954940 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-788d5b9b-45e5-468c-b275-4242ae27fb7a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.162486 Jul 18 15:20:53.955514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 483/958] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:53 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:53.959268 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.959722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:53.960503 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:53.960940 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:54.101523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:54.109736 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4f197bf3-64d7-4353-876c-9d6173166c50 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.161525 Jul 18 15:20:54.110327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 476/959] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:53 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:54.526994 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:54.527622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:54.534123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:54.534601 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:54.535381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:54.535818 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:54.669152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:54.677258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-24a75f74-06b5-443d-b2bf-f4a6db6c658d tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1674 microversion: 2.1 time: 0.154944 Jul 18 15:20:54.677847 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 484/960] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:54 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:54.973690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:54.974399 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:54.981770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:54.982219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:54.983035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:54.983471 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:55.120678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:55.127629 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:55.128251 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:55.131266 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:55.132787 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:55.135289 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ed4861e8-6175-4be3-b450-974fb85ec71a tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.165890 Jul 18 15:20:55.135867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 477/961] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:54 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:55.136032 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:55.136473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:55.137253 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:55.137688 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:55.350134 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:55.358585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3b393081-df46-46dc-81fe-d2b44813ae4b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.234848 Jul 18 15:20:55.359192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 485/962] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:55 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:55.694691 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:55.695351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:55.703137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:55.706779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:55.706779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:55.706779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:55.843564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:55.852376 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-81120c24-fc54-4b8b-9f96-8375043cdd40 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1674 microversion: 2.1 time: 0.161185 Jul 18 15:20:55.852981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 478/963] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:55 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:56.156509 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:56.157137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:56.165353 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.165855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.166843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.167234 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.217516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-d51c33b5-ff69-4143-84fb-121cbd7eb744 req-7f9f4ac4-b665-468a-9b1d-4512cf22acb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1", "name": "network-vif-deleted", "tag": "6d25626f-5301-4222-b3c1-fc3264ffecec"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:20:56.226722 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-d51c33b5-ff69-4143-84fb-121cbd7eb744 req-7f9f4ac4-b665-468a-9b1d-4512cf22acb7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.228485 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-d51c33b5-ff69-4143-84fb-121cbd7eb744 req-7f9f4ac4-b665-468a-9b1d-4512cf22acb7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.232981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:20:56.241699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-d51c33b5-ff69-4143-84fb-121cbd7eb744 req-7f9f4ac4-b665-468a-9b1d-4512cf22acb7 service nova] Creating event network-vif-deleted:6d25626f-5301-4222-b3c1-fc3264ffecec for instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 on hv-cinder-83697 Jul 18 15:20:56.248216 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-d51c33b5-ff69-4143-84fb-121cbd7eb744 req-7f9f4ac4-b665-468a-9b1d-4512cf22acb7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034630 Jul 18 15:20:56.248836 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 479/964] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:20:56.339185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:56.357878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:56.364300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:56.364300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f3f4945b-9813-43f2-b623-64213829b7bd tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.209823 Jul 18 15:20:56.364300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 486/965] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:56 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 15:20:56.378599 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:56.379622 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:56.406403 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.406914 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.407968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.408590 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.591309 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:56.601229 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f3ddf68c-0184-4c6a-87b6-bae8b785e58d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.227961 Jul 18 15:20:56.602714 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 480/966] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:56 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:56.871488 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:56.872119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:56.878391 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.878895 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.879723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:56.880231 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:56.953719 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b86eef7820462fa4e6cbb22f30b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb30e124ce7458f9c29e6c6ae3d95f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:56.963760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-88e707f4-159c-4789-839f-851973774c02 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 200 len: 1323 microversion: 2.1 time: 0.096722 Jul 18 15:20:56.964286 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 487/967] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:56 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:20:57.380258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:57.380975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:57.388605 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:57.389063 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:57.389871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:57.391036 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:57.535327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:57.544747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:57.546274 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:57.547513 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-02b10e5c-7399-4aab-a02e-c96cc1a43582 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1730 microversion: 2.20 time: 0.171232 Jul 18 15:20:57.548087 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 481/968] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:57 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:57.622587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:57.623244 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:57.629975 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:57.630437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:57.631280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:57.631718 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:57.776058 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:57.783976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e2f81e21-c545-472f-bfcc-3ccee5bef00f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.168246 Jul 18 15:20:57.784567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 488/969] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:57 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:20:57.981759 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:57.982369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:57.988985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:57.989444 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:57.990365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:57.990888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:58.005511 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] HTTP exception thrown: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Request method failure captured: Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 HTTP/1.1 Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xiha2u9sPk9JX0kiquGFuePTCPnBa9Fk7_tqezgLuJmK8Y_eh-ipT4_ROWN_x4wVj677Wm8FIANYKLCw5QQ5Yl21dX_4XD1rggREZ6wNtP390R0qWGYNWoZv2F3BrHYpT0lH3OzAfJHkfcI0q9-RIPS1bN3lLibSWMaqnISpt3mxiw Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:20:58.007308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7cb30e124ce7458f9c29e6c6ae3d95f0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 22b86eef7820462fa4e6cbb22f30b853 Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:20:58.008804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': 'a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1'} Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:20:58.009635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:20:58.011449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:20:58.012709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Returning 404 to user: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:20:58.012709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f993d995-ff58-4610-83a9-9d90cf71e805 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 404 len: 111 microversion: 2.1 time: 0.032074 Jul 18 15:20:58.012709 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 482/970] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:57 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:20:58.018285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-27894a31-1d82-4981-a8d0-a81035600bff tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '.version_select at 0x7f48c1e84dc0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:58.114348 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-27894a31-1d82-4981-a8d0-a81035600bff tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588280028" status: 202 len: 0 microversion: 2.1 time: 0.099853 Jul 18 15:20:58.115020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 489/971] 10.222.0.83 () {58 vars in 1220 bytes} [Mon Jul 18 15:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588280028 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:20:58.566878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:58.567522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:58.574847 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:58.577261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:58.577261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:58.577261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:58.781265 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:58.792238 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:58.793822 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:58.795074 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-cdd701ef-394d-454b-aeb9-84de95098e9b tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1717 microversion: 2.20 time: 0.232254 Jul 18 15:20:58.795678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 483/972] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:20:58 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1717 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:20:58.802761 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:20:58.803398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:20:58.810963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:58.811445 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:58.812273 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:20:58.812739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:20:58.987969 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:20:58.997114 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-637e297c-b841-4fab-a18c-3d96db78b30d tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.198117 Jul 18 15:20:59.006919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 490/973] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:20:58 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:00.014882 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:00.015495 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:00.022156 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:00.022753 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:00.024050 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:00.024509 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:00.163841 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:00.171829 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-62de5e2f-ff04-4186-8fbb-e821320db262 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.161023 Jul 18 15:21:00.172438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 484/974] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:00 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:01.072982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-cdb00dab-445a-4239-8c73-e1da5411afa0 req-9b96f7de-7e88-4dc4-8f29-847d82fae161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "name": "network-vif-plugged", "status": "completed", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:01.082128 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cdb00dab-445a-4239-8c73-e1da5411afa0 req-9b96f7de-7e88-4dc4-8f29-847d82fae161 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.082600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cdb00dab-445a-4239-8c73-e1da5411afa0 req-9b96f7de-7e88-4dc4-8f29-847d82fae161 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.094572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-cdb00dab-445a-4239-8c73-e1da5411afa0 req-9b96f7de-7e88-4dc4-8f29-847d82fae161 service nova] Creating event network-vif-plugged:235acfe0-1c77-4d1b-a14c-fd642227cae1 for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e on hv-cinder-83697 Jul 18 15:21:01.100056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-cdb00dab-445a-4239-8c73-e1da5411afa0 req-9b96f7de-7e88-4dc4-8f29-847d82fae161 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032749 Jul 18 15:21:01.100727 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 491/975] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:01.190035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:01.190643 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:01.191226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:01.191689 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:01.199918 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.200519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.201422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.201578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.201943 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.202146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.202801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.203452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.208324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:01.230867 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:21:01.352822 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:01.363935 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f3438b65-a71a-4f64-9b30-64ea2bfe5dcf tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.178328 Jul 18 15:21:01.374500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 485/976] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:01 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:01.524831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b468dd51-5436-45e5-aaab-b17fb4b27216 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 204 len: 0 microversion: 2.1 time: 0.338241 Jul 18 15:21:01.525738 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 492/977] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:21:01 2022] DELETE /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 15:21:01.534363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:01.535012 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:01.542835 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.543289 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.544072 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.544507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.576456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:01.577056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:01.583555 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.584886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.584886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.585247 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.600599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] HTTP exception thrown: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Request method failure captured: Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 HTTP/1.1 Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xiha2u9sPk9JX0kiquGFuePTCPnBa9Fk7_tqezgLuJmK8Y_eh-ipT4_ROWN_x4wVj677Wm8FIANYKLCw5QQ5Yl21dX_4XD1rggREZ6wNtP390R0qWGYNWoZv2F3BrHYpT0lH3OzAfJHkfcI0q9-RIPS1bN3lLibSWMaqnISpt3mxiw Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:21:01.603612 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7cb30e124ce7458f9c29e6c6ae3d95f0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 22b86eef7820462fa4e6cbb22f30b853 Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.605401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': 'a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1'} Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:01.606211 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.607571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.608842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Returning 404 to user: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:01.608842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-92a2d2b1-2865-468f-b176-3350c63fee43 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 404 len: 111 microversion: 2.1 time: 0.033198 Jul 18 15:21:01.608842 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 493/978] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:21:01 2022] DELETE /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:21:01.615022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:01.615645 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:01.624013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.624613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.625433 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:01.626031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:01.640919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] HTTP exception thrown: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Request method failure captured: Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 HTTP/1.1 Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xiha2u9sPk9JX0kiquGFuePTCPnBa9Fk7_tqezgLuJmK8Y_eh-ipT4_ROWN_x4wVj677Wm8FIANYKLCw5QQ5Yl21dX_4XD1rggREZ6wNtP390R0qWGYNWoZv2F3BrHYpT0lH3OzAfJHkfcI0q9-RIPS1bN3lLibSWMaqnISpt3mxiw Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:21:01.642827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7cb30e124ce7458f9c29e6c6ae3d95f0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 22b86eef7820462fa4e6cbb22f30b853 Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.644287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': 'a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1'} Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:01.648597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. Jul 18 15:21:01.650527 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:01.652610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Returning 404 to user: Instance a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:01.652610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ea0e19de-aa75-4ac6-9cd3-e1631aff736a tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1" status: 404 len: 111 microversion: 2.1 time: 0.034192 Jul 18 15:21:01.652610 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 494/979] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:01 2022] GET /compute/v2.1/servers/a80a1c42-6e8d-4ec1-b8ca-1236b6a1a5f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:21:01.700308 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:01.708385 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-996b99ea-2c30-4117-a1d1-c80a6580bff7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1575 microversion: 2.1 time: 0.178036 Jul 18 15:21:01.708976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 486/980] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:01 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:02.383422 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:02.384125 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:02.390692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.391137 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.391906 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.392365 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.530309 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:02.538223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a61b9c51-c5de-4e5f-9074-b6b7d5a8b141 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.159116 Jul 18 15:21:02.538849 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 495/981] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:02 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:02.727848 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:02.728420 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:02.735366 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.735827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.736608 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.737054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.880945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:02.889015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-dc22ddb9-e483-48ab-8d49-015b9f27763a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1575 microversion: 2.1 time: 0.166066 Jul 18 15:21:02.889614 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 487/982] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:02 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:02.928504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:02.929533 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:02.935727 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.936195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.937041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.937487 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.952359 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] HTTP exception thrown: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Request method failure captured: Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 HTTP/1.1 Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xiha2u9sPk9JX0kiquGFuePTCPnBa9Fk7_tqezgLuJmK8Y_eh-ipT4_ROWN_x4wVj677Wm8FIANYKLCw5QQ5Yl21dX_4XD1rggREZ6wNtP390R0qWGYNWoZv2F3BrHYpT0lH3OzAfJHkfcI0q9-RIPS1bN3lLibSWMaqnISpt3mxiw Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:21:02.958271 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7cb30e124ce7458f9c29e6c6ae3d95f0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 22b86eef7820462fa4e6cbb22f30b853 Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:02.960077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '9f39d887-9b8a-4bda-9ddc-83c684c699f5'} Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:02.961506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:02.962952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:02.965096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Returning 404 to user: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:02.965096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb28be88-5233-4965-95e0-06fe39bed943 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 404 len: 111 microversion: 2.1 time: 0.030866 Jul 18 15:21:02.965096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 496/983] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:21:02 2022] DELETE /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:21:02.967159 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:02.967779 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] [instance: 9f39d887-9b8a-4bda-9ddc-83c684c699f5] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:02.974363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.974856 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.975662 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:02.976102 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:02.991568 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] HTTP exception thrown: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Request method failure captured: Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 HTTP/1.1 Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xiha2u9sPk9JX0kiquGFuePTCPnBa9Fk7_tqezgLuJmK8Y_eh-ipT4_ROWN_x4wVj677Wm8FIANYKLCw5QQ5Yl21dX_4XD1rggREZ6wNtP390R0qWGYNWoZv2F3BrHYpT0lH3OzAfJHkfcI0q9-RIPS1bN3lLibSWMaqnISpt3mxiw Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:21:02.993585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7cb30e124ce7458f9c29e6c6ae3d95f0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7cb30e124ce7458f9c29e6c6ae3d95f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 7cb30e124ce7458f9c29e6c6ae3d95f0 Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1804225814 Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 22b86eef7820462fa4e6cbb22f30b853 Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeTestJSON-1804225814-project Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:03.013171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '9f39d887-9b8a-4bda-9ddc-83c684c699f5'} Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:03.014135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. Jul 18 15:21:03.015828 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:03.017263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] Returning 404 to user: Instance 9f39d887-9b8a-4bda-9ddc-83c684c699f5 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:03.017263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-29e80978-12ef-4879-b3b5-cb62cde12129 tempest-AttachVolumeTestJSON-1804225814 tempest-AttachVolumeTestJSON-1804225814-project] 10.222.0.83 "GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5" status: 404 len: 111 microversion: 2.1 time: 0.033086 Jul 18 15:21:03.017263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 488/984] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:02 2022] GET /compute/v2.1/servers/9f39d887-9b8a-4bda-9ddc-83c684c699f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:21:03.557900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:03.558669 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:03.566744 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:03.567292 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:03.568171 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:03.568707 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:03.720480 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:03.729423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a5bd813f-edfe-4c2e-a775-1de18a301685 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1574 microversion: 2.1 time: 0.176056 Jul 18 15:21:03.730008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 497/985] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:03 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:03.907016 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:03.907688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:03.915574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:03.916025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:03.916803 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:03.917243 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:04.126314 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:04.135238 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c8712c7b-5ca3-4642-8c53-5815b11ec4e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1575 microversion: 2.1 time: 0.232172 Jul 18 15:21:04.136127 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 489/986] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:03 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:04.748014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:04.748645 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:04.751381 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:04.756548 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:04.757006 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:04.757853 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:04.758226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:04.996397 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:05.005109 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3fb5c9ac-f636-49cd-bc02-6506ef848d12 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1561 microversion: 2.1 time: 0.260738 Jul 18 15:21:05.005502 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 498/987] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:04 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1561 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:05.056869 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-e481ce11-11b1-49d9-a721-e00607152147 req-d6e779b8-ab07-4c74-a7a0-e608467ce9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a0fa7-898e-4bdd-9a61-8ed362f942be", "name": "network-vif-deleted", "tag": "2d834c80-f254-424d-8f17-9e435fae87c0"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:05.089093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-e481ce11-11b1-49d9-a721-e00607152147 req-d6e779b8-ab07-4c74-a7a0-e608467ce9f9 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:05.089611 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-e481ce11-11b1-49d9-a721-e00607152147 req-d6e779b8-ab07-4c74-a7a0-e608467ce9f9 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:05.107998 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-e481ce11-11b1-49d9-a721-e00607152147 req-d6e779b8-ab07-4c74-a7a0-e608467ce9f9 service nova] Creating event network-vif-deleted:2d834c80-f254-424d-8f17-9e435fae87c0 for instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be on hv-cinder-83697 Jul 18 15:21:05.115138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-e481ce11-11b1-49d9-a721-e00607152147 req-d6e779b8-ab07-4c74-a7a0-e608467ce9f9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062036 Jul 18 15:21:05.116682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 490/988] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:05.153968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:05.154501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:05.164819 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:05.168007 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:05.171174 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:05.177617 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:05.295515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:05.307402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-98e50423-1ac2-4042-9093-84e6861da4d0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1508 microversion: 2.1 time: 0.158329 Jul 18 15:21:05.324399 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 499/989] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:05 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:06.332739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:06.334117 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:06.342170 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:06.343108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:06.345023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:06.348663 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:06.405796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:06.406360 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:06.407161 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lazy-loading 'fault' on Instance uuid 0f0a0fa7-898e-4bdd-9a61-8ed362f942be {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:21:06.464685 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:06.484188 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d1301b67-c62c-4dc8-a5e3-f8cb9da5b736 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 200 len: 1228 microversion: 2.1 time: 0.160450 Jul 18 15:21:06.485794 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 491/990] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:06 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 1228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:07.504752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:07.505390 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:07.512786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:07.513243 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:07.514025 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:07.514463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:07.529656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] HTTP exception thrown: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Request method failure captured: Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be HTTP/1.1 Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XmD8GDqu7iaLOtpykvryH3taVjUt4e86R4BCV4IW5kx8qszI_hGAT7G4-vgaYt8YBDl_UaSS9tiNtwCTriUGgQQRyV8IbyVqlSTmKpqjF-o-5QYHUx9pj5zq8glbTKz21zN_EM_7WKeLhF2DLO_4kzNv6KGANrS4-Thx5s2z0BfEiU Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:21:07.531303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_94513773e0c94187bbdaeb82c7304eae", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 6bfa2a00688d4eab993059ff176d8920 Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:21:07.532737 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '0f0a0fa7-898e-4bdd-9a61-8ed362f942be'} Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:07.533889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:21:07.535602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:07.537473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Returning 404 to user: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:07.537473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b526985c-3e6a-48f9-a7dd-be3b939b924b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 404 len: 111 microversion: 2.1 time: 0.031895 Jul 18 15:21:07.540265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 500/991] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:07 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:21:07.665944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-287772215", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577847118", "security_groups": [{"name": "tempest-secgroup-smoke-606153650"}], "block_device_mapping_v2": [{"uuid": "f5722306-0c6b-43f9-9347-52498ce6ab11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dccabfdf-5758-41b0-add6-21d121e89ad0"}]}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:07.784343 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] validate_networks() for [('dccabfdf-5758-41b0-add6-21d121e89ad0', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:21:07.978699 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=70 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:08.196081 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:21:08.196585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:21:08.197076 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:21:08.197499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:21:08.197925 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:21:08.207675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:08.208164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:08.208976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:08.209423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:08.227849 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for project 94513773e0c94187bbdaeb82c7304eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:21:08.232009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for user 6bfa2a00688d4eab993059ff176d8920 and project 94513773e0c94187bbdaeb82c7304eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:21:08.300562 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:21:08.302767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5722306-0c6b-43f9-9347-52498ce6ab11',volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:21:08.864042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-09d67448-34dd-4dde-bee5-5375a5082339 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.196657 Jul 18 15:21:08.864042 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 492/992] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:21:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 15:21:08.870970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9413ff8-80a7-4c3c-89d6-23b41a4d42d5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:08.871724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9413ff8-80a7-4c3c-89d6-23b41a4d42d5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:08.947941 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9413ff8-80a7-4c3c-89d6-23b41a4d42d5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:08.955860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9413ff8-80a7-4c3c-89d6-23b41a4d42d5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1093 microversion: 2.1 time: 0.089537 Jul 18 15:21:08.956464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 501/993] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:08 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:21:09.974401 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:09.975058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:09.982158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:09.982648 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:09.983452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:09.983945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:10.050642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:10.059978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-edc5bd02-367f-4018-97d3-974fb680f92c tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1143 microversion: 2.1 time: 0.090452 Jul 18 15:21:10.060575 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 493/994] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:09 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:11.077712 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:11.078566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:11.087028 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:11.087490 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:11.088319 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:11.088769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:11.186293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:11.194280 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1cfda45a-5c11-49bf-93aa-25995f225b8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1199 microversion: 2.1 time: 0.120560 Jul 18 15:21:11.195192 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 502/995] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:11 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:12.221758 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:12.223132 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:12.231563 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:12.234827 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:12.239151 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:12.239942 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:12.591724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:12.612713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a2308a67-403e-4681-be1d-05872a24deab tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1276 microversion: 2.1 time: 0.394445 Jul 18 15:21:12.613380 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 494/996] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:12 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1276 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:21:13.200049 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-476e17f6-b087-4231-a540-3800ca23b1c3 req-5ac6b6ee-208c-4cc5-b20c-6fb7adf18e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6280155e-8c55-4a6f-a0a6-8c3dea47bf58", "tag": "f5a0dc2f-72ce-4f3f-808f-0c62de00f21d"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:13.219068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-476e17f6-b087-4231-a540-3800ca23b1c3 req-5ac6b6ee-208c-4cc5-b20c-6fb7adf18e6e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:13.220322 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-476e17f6-b087-4231-a540-3800ca23b1c3 req-5ac6b6ee-208c-4cc5-b20c-6fb7adf18e6e service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:13.254777 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-476e17f6-b087-4231-a540-3800ca23b1c3 req-5ac6b6ee-208c-4cc5-b20c-6fb7adf18e6e service nova] Creating event network-changed:f5a0dc2f-72ce-4f3f-808f-0c62de00f21d for instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 on hv-cinder-83697 Jul 18 15:21:13.268663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-476e17f6-b087-4231-a540-3800ca23b1c3 req-5ac6b6ee-208c-4cc5-b20c-6fb7adf18e6e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072581 Jul 18 15:21:13.269970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 503/997] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:13.640020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:13.642474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:13.657062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:13.657535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:13.659135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:13.659586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:13.904106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:13.913937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-79d0b91c-f715-4f53-b895-302c159015a5 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.285310 Jul 18 15:21:13.926150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 495/998] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:13 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:14.935586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:14.937082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:14.952765 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:14.955371 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:14.956900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:14.957562 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:15.280549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:15.297258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fb20da7d-aad0-4450-9018-c00b9487ec1a tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.366134 Jul 18 15:21:15.301083 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 504/999] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:14 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:16.316500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:16.317120 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:16.324411 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:16.324865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:16.325801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:16.326248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:16.580406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:16.594417 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-556838d2-eb41-4aa6-843b-e724401c3b35 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.282009 Jul 18 15:21:16.595522 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 496/1000] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:16 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:16.998121 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c88e705e-fda3-476e-8161-c27b7bd878a2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: .version_select at 0x7f48c1493a60>, body: {"keypair": {"name": "tempest-keypair-2131517230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwDxHffRvQ+OAvgg+oAICHhQN2ksGT/E1zHlCBe9S45O84VDhX3Ok5QjOoMOokeT4UdKDF7FjseZV2dp6cjRQbyAnbf6IqIluCqPboZclrCKLk913picZWcXbaXCHzqgw=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:17.013184 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-c88e705e-fda3-476e-8161-c27b7bd878a2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:21:17.017743 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-c88e705e-fda3-476e-8161-c27b7bd878a2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:21:17.153494 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c88e705e-fda3-476e-8161-c27b7bd878a2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.322247 Jul 18 15:21:17.154777 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 505/1001] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:21:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:17.613406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:17.614053 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:17.621866 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:17.622777 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:17.623577 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:17.624018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:17.821724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:17.829451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4b1e9f4a-d10e-49da-8908-29e01d8813e7 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.220299 Jul 18 15:21:17.830281 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 497/1002] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:17 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:18.848798 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:18.849461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:18.861195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:18.861653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:18.867583 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:18.868054 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:19.162117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:19.170692 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-da9a7e55-f550-42fc-88c0-f88fc8d8d807 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.327834 Jul 18 15:21:19.175068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 506/1003] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:18 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:20.106686 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-930053047", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f02ced57-ea39-45d4-8716-b5d99e92419a"}], "security_groups": [{"name": "tempest-securitygroup--1658618957"}], "key_name": "tempest-keypair-2131517230", "user_data": "}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:20.113505 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:20.114183 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:20.189052 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:20.189836 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:20.197869 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:20.198430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:20.199340 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:20.200206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:20.245326 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] validate_networks() for [('f02ced57-ea39-45d4-8716-b5d99e92419a', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:21:20.356878 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:20.365515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-922a143c-3072-4061-97fd-10e415d9e618 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.180500 Jul 18 15:21:20.366508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 507/1004] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:20 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:21:20.688594 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:21:20.689261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:21:20.689910 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:21:20.690332 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:21:20.690801 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:21:20.703025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:20.703481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:20.704297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:20.704739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:20.723059 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:21:20.727105 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:21:20.738571 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:21:20.740912 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:21:20.856020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9a8ec754-f3f5-4093-a5b8-7a0982d8d3d7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.754205 Jul 18 15:21:20.856692 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 498/1005] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:21:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:21:20.867831 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9289105b-55f6-4c94-8dd4-3fc642e673b1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:20.868606 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9289105b-55f6-4c94-8dd4-3fc642e673b1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:20.928843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9289105b-55f6-4c94-8dd4-3fc642e673b1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:20.936014 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9289105b-55f6-4c94-8dd4-3fc642e673b1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1241 microversion: 2.1 time: 0.072616 Jul 18 15:21:20.937814 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 508/1006] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:20 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:21.387470 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:21.388354 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:21.394700 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:21.395171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:21.395996 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:21.396438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:21.414148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=100 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:21.556824 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:21.564670 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-627f4011-416d-44d1-9c5b-176d9567aa8e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.183397 Jul 18 15:21:21.565277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 499/1007] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:21 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:21.954723 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:21.958300 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:21.963251 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:21.963741 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:21.964546 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:21.964993 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:22.037702 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:22.046227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-343321b6-fbaf-473c-88a9-b7baa1da3ef2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1245 microversion: 2.1 time: 0.095994 Jul 18 15:21:22.047274 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 509/1008] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:21 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:22.584543 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:22.585142 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:22.594141 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:22.594646 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:22.595480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:22.595927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:22.745438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:22.753766 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e202790d-56e8-4197-bdee-debb211915f1 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.174344 Jul 18 15:21:22.754374 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 500/1009] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:22 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:23.064160 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:23.064941 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:23.072201 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:23.072471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:23.073185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:23.073622 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:23.157675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:23.167224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5125073f-32b9-44c8-8071-fd9ad8c46d42 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1293 microversion: 2.1 time: 0.107095 Jul 18 15:21:23.167857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 510/1010] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:23 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:23.255583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-21b6e72e-b7c8-4cdc-9723-8e86eed1b9df req-6828d593-95d5-4cc1-bb11-5103a16e409c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6280155e-8c55-4a6f-a0a6-8c3dea47bf58", "name": "network-vif-plugged", "status": "completed", "tag": "f5a0dc2f-72ce-4f3f-808f-0c62de00f21d"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:23.265991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-21b6e72e-b7c8-4cdc-9723-8e86eed1b9df req-6828d593-95d5-4cc1-bb11-5103a16e409c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:23.265991 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-21b6e72e-b7c8-4cdc-9723-8e86eed1b9df req-6828d593-95d5-4cc1-bb11-5103a16e409c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:23.283946 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-21b6e72e-b7c8-4cdc-9723-8e86eed1b9df req-6828d593-95d5-4cc1-bb11-5103a16e409c service nova] Creating event network-vif-plugged:f5a0dc2f-72ce-4f3f-808f-0c62de00f21d for instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 on hv-cinder-83697 Jul 18 15:21:23.290629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-21b6e72e-b7c8-4cdc-9723-8e86eed1b9df req-6828d593-95d5-4cc1-bb11-5103a16e409c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038989 Jul 18 15:21:23.291282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 501/1011] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:23.773294 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:23.773966 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:23.785532 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:23.786389 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:23.787360 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:23.787958 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:24.018609 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:24.026974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f4fa770e-4104-47b6-b736-97f72bec2bf0 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.258505 Jul 18 15:21:24.027900 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 511/1012] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:23 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:24.192479 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:24.193171 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:24.200673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:24.201128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:24.201919 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:24.202361 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:24.271834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:24.279909 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b2892ebc-18bc-4867-97af-73628e96c0bc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1299 microversion: 2.1 time: 0.092724 Jul 18 15:21:24.280507 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 502/1013] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:24 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:25.044988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:25.045611 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:25.052643 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:25.053093 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:25.053961 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:25.055168 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:25.297490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:25.298172 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:25.314387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:25.314888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:25.315687 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:25.316133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:25.369976 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:25.381496 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4447915b-3427-477a-930a-ada6ccf8ca59 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1264 microversion: 2.1 time: 0.340223 Jul 18 15:21:25.382333 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 512/1014] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:25 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:21:25.481712 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:25.493368 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-10a10de6-25d4-4269-b900-39b1169be6ad tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.199758 Jul 18 15:21:25.493981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 503/1015] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:25 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:25.593674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-e3239644-8b37-4618-8221-3ee7a9969c70 req-45762582-951c-4221-b2f3-8ceaad217f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21494892-e0fd-4cd0-b274-4303d90e7817", "tag": "665511ed-7023-40e9-b6f7-da66ba4c98ed"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:25.614924 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-e3239644-8b37-4618-8221-3ee7a9969c70 req-45762582-951c-4221-b2f3-8ceaad217f06 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:25.614924 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-e3239644-8b37-4618-8221-3ee7a9969c70 req-45762582-951c-4221-b2f3-8ceaad217f06 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:25.628706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-e3239644-8b37-4618-8221-3ee7a9969c70 req-45762582-951c-4221-b2f3-8ceaad217f06 service nova] Creating event network-changed:665511ed-7023-40e9-b6f7-da66ba4c98ed for instance 21494892-e0fd-4cd0-b274-4303d90e7817 on hv-cinder-83697 Jul 18 15:21:25.643967 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-e3239644-8b37-4618-8221-3ee7a9969c70 req-45762582-951c-4221-b2f3-8ceaad217f06 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055267 Jul 18 15:21:25.644855 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 513/1016] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:21:26.400731 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:26.401445 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:26.408711 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:26.409157 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:26.409957 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:26.410402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:26.513332 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:26.514044 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:26.521269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:26.521852 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:26.522937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:26.523661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:26.528772 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:26.571532 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:26.580149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-484391b5-9a79-4ebf-b558-15f77f2dfe4e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1452 microversion: 2.1 time: 0.184637 Jul 18 15:21:26.580754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 504/1017] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:26 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:26.598355 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:26.598924 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:26.606119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:26.606624 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:26.607676 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:26.608133 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:26.762853 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:26.770951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2df58637-feac-448d-ac2e-7dbfa74346bf tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1452 microversion: 2.1 time: 0.176880 Jul 18 15:21:26.775639 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 505/1018] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:26 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:26.831405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:26.839747 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-99cf7f91-0b32-42ce-ac47-9d1bca27a524 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.332454 Jul 18 15:21:26.840433 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 514/1019] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:26 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:21:27.857983 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:27.858626 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:27.865456 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:27.865916 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:27.867221 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:27.867681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:28.079252 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:28.086923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-aaed17ae-7520-402c-b918-c1140cd2af6a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.233018 Jul 18 15:21:28.087623 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 506/1020] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:27 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:29.106219 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:29.106829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:29.114269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:29.114790 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:29.115908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:29.116130 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:29.278259 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-9275e601-7a19-4c3a-981f-f16fdd2b0247 req-b3e5736b-16e8-4748-8016-b3e8693da5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6280155e-8c55-4a6f-a0a6-8c3dea47bf58", "tag": "f5a0dc2f-72ce-4f3f-808f-0c62de00f21d"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:29.293082 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:29.295564 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-9275e601-7a19-4c3a-981f-f16fdd2b0247 req-b3e5736b-16e8-4748-8016-b3e8693da5f2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:29.296105 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-9275e601-7a19-4c3a-981f-f16fdd2b0247 req-b3e5736b-16e8-4748-8016-b3e8693da5f2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:29.297858 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0a80d4b3-4168-4ada-b70a-1142d34e3218 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.196782 Jul 18 15:21:29.299566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 515/1021] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:29 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:29.337057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-9275e601-7a19-4c3a-981f-f16fdd2b0247 req-b3e5736b-16e8-4748-8016-b3e8693da5f2 service nova] Creating event network-changed:f5a0dc2f-72ce-4f3f-808f-0c62de00f21d for instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 on hv-cinder-83697 Jul 18 15:21:29.350116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-9275e601-7a19-4c3a-981f-f16fdd2b0247 req-b3e5736b-16e8-4748-8016-b3e8693da5f2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076310 Jul 18 15:21:29.352852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 507/1022] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:21:30.316087 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:30.316978 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:30.324584 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:30.324883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:30.325584 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:30.326446 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:30.472574 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:30.481608 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-07f6f294-bff7-412b-9878-c6404f0958f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.169441 Jul 18 15:21:30.482208 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 516/1023] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:30 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:31.308580 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:31.309813 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:31.315149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-d1825c1e-6075-481c-9b4d-7053dbe888a9 req-23d56d9d-1911-4c89-ad0f-8e8088aae34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21494892-e0fd-4cd0-b274-4303d90e7817", "name": "network-vif-plugged", "status": "completed", "tag": "665511ed-7023-40e9-b6f7-da66ba4c98ed"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:31.329354 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-d1825c1e-6075-481c-9b4d-7053dbe888a9 req-23d56d9d-1911-4c89-ad0f-8e8088aae34a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.329962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-d1825c1e-6075-481c-9b4d-7053dbe888a9 req-23d56d9d-1911-4c89-ad0f-8e8088aae34a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.342503 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-d1825c1e-6075-481c-9b4d-7053dbe888a9 req-23d56d9d-1911-4c89-ad0f-8e8088aae34a service nova] Creating event network-vif-plugged:665511ed-7023-40e9-b6f7-da66ba4c98ed for instance 21494892-e0fd-4cd0-b274-4303d90e7817 on hv-cinder-83697 Jul 18 15:21:31.347906 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-d1825c1e-6075-481c-9b4d-7053dbe888a9 req-23d56d9d-1911-4c89-ad0f-8e8088aae34a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040751 Jul 18 15:21:31.353780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 508/1024] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:31.498884 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:31.499450 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:31.501282 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=8 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:31.506783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.507765 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.509213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.509663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.674824 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:31.684821 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c11f8a16-f04f-40df-b1e6-e934dc1e30af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.189917 Jul 18 15:21:31.691916 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 517/1025] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:31 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:31.827415 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:31.828473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:31.836175 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.836770 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.837637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.838135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.870662 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6686218a-f9a9-49e9-890b-b3584df5a695 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048630 Jul 18 15:21:31.871245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 509/1026] 10.222.0.83 () {60 vars in 1342 bytes} [Mon Jul 18 15:21:31 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:31.932614 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:31.933115 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:31.939411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.939864 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.940658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:31.941099 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:31.967221 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:21:32.341308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-52b2a0fe-7d5b-4867-8c98-a1f7fe8f34e1 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 204 len: 0 microversion: 2.20 time: 0.412514 Jul 18 15:21:32.341913 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 518/1027] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Jul 18 15:21:31 2022] DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 15:21:32.351763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:32.352424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:32.359189 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:32.359645 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:32.360474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:32.360874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:32.521008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:32.529625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:32.531198 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:32.532392 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c20cadc4-2e67-49a0-be31-849f3e0d6140 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.185811 Jul 18 15:21:32.532971 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 510/1028] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:32 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:21:32.705298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:32.706001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:32.713572 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:32.714024 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:32.714857 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:32.715331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:32.860662 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:32.868661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-411a719e-9d1c-433d-b758-0ec195a51467 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.168044 Jul 18 15:21:32.869292 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 519/1029] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:32 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:21:33.550995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:33.551600 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:33.560217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:33.560573 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:33.561362 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:33.561798 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:33.711961 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:33.720327 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:33.722116 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:33.723363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-fe6a25b5-cf57-4e56-8fbe-b8b8a20c14e7 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.176596 Jul 18 15:21:33.723938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 511/1030] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:33 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:21:33.886298 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:33.886902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:33.893728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:33.894176 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:33.894998 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:33.895441 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:34.034530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:34.042630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-17f07049-acbb-401a-ba42-0cae8a22496f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1367 microversion: 2.1 time: 0.161455 Jul 18 15:21:34.043206 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 520/1031] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:33 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:34.742639 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:34.743261 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:34.750710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:34.751183 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:34.752898 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:34.753339 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:34.950169 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:34.962290 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:34.964224 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:34.965726 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-736e171d-0cfc-4d6d-a3ed-276aff238739 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1723 microversion: 2.20 time: 0.227565 Jul 18 15:21:34.966385 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 512/1032] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:34 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:21:35.063578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:35.064283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:35.067504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:35.076042 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.076861 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:35.078294 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.079151 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:35.355696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:35.363802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b46087af-7091-44b4-b2d2-253317e595fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1557 microversion: 2.1 time: 0.305694 Jul 18 15:21:35.364410 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 521/1033] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:21:35 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1557 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:21:35.381346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:35.381949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:35.388886 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.389044 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:35.389749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.390198 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:35.475217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0c24693c-b584-41e4-b239-6ea723ad1e43 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097908 Jul 18 15:21:35.476375 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 513/1034] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:21:35 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:21:35.936223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-46004485-8dff-40c7-8f17-19290e1ec573 req-19b9ce62-8e60-4167-bb3c-9f058eb3f550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5c527a-8a3f-408e-b203-3b0be66fc001", "name": "network-vif-deleted", "tag": "52d6d774-b176-47fa-8883-719a355d176e"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:35.947614 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-46004485-8dff-40c7-8f17-19290e1ec573 req-19b9ce62-8e60-4167-bb3c-9f058eb3f550 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.948401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-46004485-8dff-40c7-8f17-19290e1ec573 req-19b9ce62-8e60-4167-bb3c-9f058eb3f550 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:35.965031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-46004485-8dff-40c7-8f17-19290e1ec573 req-19b9ce62-8e60-4167-bb3c-9f058eb3f550 service nova] Creating event network-vif-deleted:52d6d774-b176-47fa-8883-719a355d176e for instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 on hv-cinder-83697 Jul 18 15:21:35.972654 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-46004485-8dff-40c7-8f17-19290e1ec573 req-19b9ce62-8e60-4167-bb3c-9f058eb3f550 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043701 Jul 18 15:21:35.978902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 522/1035] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:35.987866 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:35.993931 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:35.996965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.997680 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:35.998745 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:35.999409 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:36.125069 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:36.145414 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:36.154017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3f0c37e426640f9960c1da232605e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea95f701696f4c28b2d4bbef9d0af45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:21:36.154017 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4e6b6429-e94a-4bc0-bb3d-37187fbd858d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 200 len: 1656 microversion: 2.20 time: 0.169599 Jul 18 15:21:36.156030 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 514/1036] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:35 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 15:21:36.742809 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-b36b0de2-464a-479a-af90-769a3c68a542 req-de1b3376-a999-47d0-a225-542132e02f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21494892-e0fd-4cd0-b274-4303d90e7817", "tag": "665511ed-7023-40e9-b6f7-da66ba4c98ed"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:21:36.755136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b36b0de2-464a-479a-af90-769a3c68a542 req-de1b3376-a999-47d0-a225-542132e02f69 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:36.756057 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b36b0de2-464a-479a-af90-769a3c68a542 req-de1b3376-a999-47d0-a225-542132e02f69 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:36.775639 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-b36b0de2-464a-479a-af90-769a3c68a542 req-de1b3376-a999-47d0-a225-542132e02f69 service nova] Creating event network-changed:665511ed-7023-40e9-b6f7-da66ba4c98ed for instance 21494892-e0fd-4cd0-b274-4303d90e7817 on hv-cinder-83697 Jul 18 15:21:36.782330 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-b36b0de2-464a-479a-af90-769a3c68a542 req-de1b3376-a999-47d0-a225-542132e02f69 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044347 Jul 18 15:21:36.783504 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 523/1037] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:21:37.177675 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:37.178306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:37.186205 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:37.186773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:37.187718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:37.188158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:37.204294 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] HTTP exception thrown: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Request method failure captured: Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 HTTP/1.1 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XiliUCmtPoHfjKcSAmAntUtKYmHXN9t9S4KxVcLYlR0olanBpUT0PSt_r205KizBwxvD8fraKSzMScPAt_CGVnrLJ29h15EO9vm2zanuiQeV_VC8V8k4DQyjJj6lgmmr-GO67-1Qs7UflC6Pi1CRflicMo0HZxWcqSpvw-faWkSAS4 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:21:37.206240 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ea95f701696f4c28b2d4bbef9d0af45d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: f3f0c37e426640f9960c1da232605e55 Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:37.210570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '2f5c527a-8a3f-408e-b203-3b0be66fc001'} Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:37.216434 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:37.227852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:37.232402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Returning 404 to user: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:37.232402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7f304d2a-82a6-42f8-9a89-74c369e39d6f tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 404 len: 111 microversion: 2.20 time: 0.034023 Jul 18 15:21:37.232402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 515/1038] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:37 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:21:37.232911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-811c4e87-972a-41eb-a95b-466fd7c8536d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '.version_select at 0x7f48c1df2820>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:37.324964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-811c4e87-972a-41eb-a95b-466fd7c8536d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388876693" status: 204 len: 0 microversion: 2.20 time: 0.110686 Jul 18 15:21:37.325581 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 524/1039] 10.222.0.83 () {60 vars in 1258 bytes} [Mon Jul 18 15:21:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388876693 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 15:21:39.577871 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:39.578402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:39.580861 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:21:39.586981 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:39.590064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:39.590064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:39.590064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:39.603400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] HTTP exception thrown: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Request method failure captured: Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 HTTP/1.1 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XiliUCmtPoHfjKcSAmAntUtKYmHXN9t9S4KxVcLYlR0olanBpUT0PSt_r205KizBwxvD8fraKSzMScPAt_CGVnrLJ29h15EO9vm2zanuiQeV_VC8V8k4DQyjJj6lgmmr-GO67-1Qs7UflC6Pi1CRflicMo0HZxWcqSpvw-faWkSAS4 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:21:39.604985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ea95f701696f4c28b2d4bbef9d0af45d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: f3f0c37e426640f9960c1da232605e55 Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.606834 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '2f5c527a-8a3f-408e-b203-3b0be66fc001'} Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:39.607879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.609464 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.611077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Returning 404 to user: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:39.611077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e893bd2b-7027-4aef-b89c-d13f343e2380 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 404 len: 111 microversion: 2.20 time: 0.032655 Jul 18 15:21:39.611077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 516/1040] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Jul 18 15:21:39 2022] DELETE /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:21:39.616078 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:39.616914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2f5c527a-8a3f-408e-b203-3b0be66fc001] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:39.623398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:39.623851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:39.624630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:39.625072 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:39.639588 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] HTTP exception thrown: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Request method failure captured: Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 HTTP/1.1 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XiliUCmtPoHfjKcSAmAntUtKYmHXN9t9S4KxVcLYlR0olanBpUT0PSt_r205KizBwxvD8fraKSzMScPAt_CGVnrLJ29h15EO9vm2zanuiQeV_VC8V8k4DQyjJj6lgmmr-GO67-1Qs7UflC6Pi1CRflicMo0HZxWcqSpvw-faWkSAS4 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:21:39.641297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ea95f701696f4c28b2d4bbef9d0af45d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: f3f0c37e426640f9960c1da232605e55 Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.643015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '2f5c527a-8a3f-408e-b203-3b0be66fc001'} Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:39.643891 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. Jul 18 15:21:39.645413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:39.646763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Returning 404 to user: Instance 2f5c527a-8a3f-408e-b203-3b0be66fc001 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:39.646763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8eddd9d0-564b-4319-9a5c-5df66b42346d tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001" status: 404 len: 111 microversion: 2.20 time: 0.031246 Jul 18 15:21:39.646763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 525/1041] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:39 2022] GET /compute/v2.1/servers/2f5c527a-8a3f-408e-b203-3b0be66fc001 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:21:40.936089 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:40.936618 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:40.943789 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:40.944896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:40.945682 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:40.946149 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:40.960467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] HTTP exception thrown: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Request method failure captured: Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 HTTP/1.1 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XiliUCmtPoHfjKcSAmAntUtKYmHXN9t9S4KxVcLYlR0olanBpUT0PSt_r205KizBwxvD8fraKSzMScPAt_CGVnrLJ29h15EO9vm2zanuiQeV_VC8V8k4DQyjJj6lgmmr-GO67-1Qs7UflC6Pi1CRflicMo0HZxWcqSpvw-faWkSAS4 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:21:40.962064 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ea95f701696f4c28b2d4bbef9d0af45d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: f3f0c37e426640f9960c1da232605e55 Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:40.963679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '2e422edc-5603-4ed9-8572-d40f50f25155'} Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:40.964554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:40.965839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:21:40.967177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Returning 404 to user: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:40.967177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-270cd1f1-4be7-4571-afbb-b9f753d29bc3 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 404 len: 111 microversion: 2.20 time: 0.031566 Jul 18 15:21:40.967177 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 517/1042] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Jul 18 15:21:40 2022] DELETE /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:21:40.973324 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:21:40.973933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] [instance: 2e422edc-5603-4ed9-8572-d40f50f25155] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:21:40.981204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:40.981653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:40.982428 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:21:40.982907 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:21:40.997868 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] HTTP exception thrown: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Request method failure captured: Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 HTTP/1.1 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XiliUCmtPoHfjKcSAmAntUtKYmHXN9t9S4KxVcLYlR0olanBpUT0PSt_r205KizBwxvD8fraKSzMScPAt_CGVnrLJ29h15EO9vm2zanuiQeV_VC8V8k4DQyjJj6lgmmr-GO67-1Qs7UflC6Pi1CRflicMo0HZxWcqSpvw-faWkSAS4 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:21:40.999472 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ea95f701696f4c28b2d4bbef9d0af45d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ea95f701696f4c28b2d4bbef9d0af45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: ea95f701696f4c28b2d4bbef9d0af45d Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1961008613 Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: f3f0c37e426640f9960c1da232605e55 Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1961008613-project Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:41.001236 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '2e422edc-5603-4ed9-8572-d40f50f25155'} Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:21:41.002135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. Jul 18 15:21:41.003796 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:21:41.005232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] Returning 404 to user: Instance 2e422edc-5603-4ed9-8572-d40f50f25155 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:21:41.005232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d7408dca-a2fa-4195-84e9-b8b2b057cbf0 tempest-AttachVolumeShelveTestJSON-1961008613 tempest-AttachVolumeShelveTestJSON-1961008613-project] 10.222.0.83 "GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155" status: 404 len: 111 microversion: 2.20 time: 0.032372 Jul 18 15:21:41.005232 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 526/1043] 10.222.0.83 () {60 vars in 1276 bytes} [Mon Jul 18 15:21:40 2022] GET /compute/v2.1/servers/2e422edc-5603-4ed9-8572-d40f50f25155 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:21:58.525669 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:21:58.526239 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:21:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:22:13.093749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:13.094414 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:13.097148 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=85 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:13.102802 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:13.103337 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:13.104027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:13.104465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:13.128937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1fe04438-30cc-4a41-94b8-f6989e8b74d5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/ips" status: 200 len: 150 microversion: 2.1 time: 0.039131 Jul 18 15:22:13.129516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 518/1044] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:22:13 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:18.098899 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aedf622-caac-4d02-878e-c2b0329318b9"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:18.101560 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:18.104149 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:18.114370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:18.114370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:18.114370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:18.114370 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:18.114811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:20.693487 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5534c30f-e535-4225-aea6-8529f18fff55 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.602396 Jul 18 15:22:20.694579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 527/1045] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:22:18 2022] POST /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments => generated 194 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:24.654831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:24.655578 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:24.658703 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-253be337-a3bf-41b8-a8c1-305e66277f02 req-379c446c-132d-45e0-bcae-708f5e8a4508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:24.659184 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=5 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:24.664713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:24.665423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:24.666306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:24.666879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:24.669451 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-253be337-a3bf-41b8-a8c1-305e66277f02 req-379c446c-132d-45e0-bcae-708f5e8a4508 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:24.670148 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-253be337-a3bf-41b8-a8c1-305e66277f02 req-379c446c-132d-45e0-bcae-708f5e8a4508 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:24.683791 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-253be337-a3bf-41b8-a8c1-305e66277f02 req-379c446c-132d-45e0-bcae-708f5e8a4508 service nova] Creating event network-changed:235acfe0-1c77-4d1b-a14c-fd642227cae1 for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e on hv-cinder-83697 Jul 18 15:22:24.689133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-253be337-a3bf-41b8-a8c1-305e66277f02 req-379c446c-132d-45e0-bcae-708f5e8a4508 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034993 Jul 18 15:22:24.689776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 528/1046] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:22:24.700219 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:22:25.027428 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3dbb5c4d-b329-408b-ae4c-b0e2a311c6ee tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 204 len: 0 microversion: 2.1 time: 0.376736 Jul 18 15:22:25.030639 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 519/1047] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:22:24 2022] DELETE /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:22:25.038967 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:25.040771 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:25.047803 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:25.048368 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:25.049363 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:25.049813 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:25.188337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:25.196790 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab766cde-7ebe-404e-ba04-5e6154b93b20 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.162522 Jul 18 15:22:25.197393 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 529/1048] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:25 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:26.215792 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:26.216399 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:26.223642 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:26.224093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:26.224891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:26.225328 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:26.391051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:26.400554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2d73a8ef-4e9d-432b-8ce3-6d52b749a448 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1567 microversion: 2.1 time: 0.189804 Jul 18 15:22:26.400869 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 520/1049] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:26 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:27.309326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-3f83e54a-ebb5-4292-abae-40e4fda4276c req-054a872c-9256-4cfb-9556-9932b57bf79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e6cc3f-8715-4d58-8c37-12d2256dc58e", "name": "network-vif-deleted", "tag": "235acfe0-1c77-4d1b-a14c-fd642227cae1"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:27.317970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3f83e54a-ebb5-4292-abae-40e4fda4276c req-054a872c-9256-4cfb-9556-9932b57bf79a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:27.318419 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3f83e54a-ebb5-4292-abae-40e4fda4276c req-054a872c-9256-4cfb-9556-9932b57bf79a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:27.330823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-3f83e54a-ebb5-4292-abae-40e4fda4276c req-054a872c-9256-4cfb-9556-9932b57bf79a service nova] Creating event network-vif-deleted:235acfe0-1c77-4d1b-a14c-fd642227cae1 for instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e on hv-cinder-83697 Jul 18 15:22:27.335991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-3f83e54a-ebb5-4292-abae-40e4fda4276c req-054a872c-9256-4cfb-9556-9932b57bf79a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Jul 18 15:22:27.336927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 530/1050] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:27.419889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:27.420920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:27.427679 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:27.428150 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:27.428964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:27.429940 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:27.496856 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:27.505027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3ff0e00e-c54a-42c1-a744-db4ee2420a7f tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1382 microversion: 2.1 time: 0.090874 Jul 18 15:22:27.505606 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 521/1051] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:27 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:28.250629 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-161ae09d-2007-42c1-9f3a-f00a4cf480f5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: .version_select at 0x7f48c1f81ee0>, body: {"keypair": {"name": "tempest-keypair-843363611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/AzwEtk55f2FLnyLysjsYiI0oSNGsMlb7P23RoQFu+EEaJGqyBRZ47J41chlnWoIUMOY3oBhTe+2w+ednLTOZX/0RvLcJ0qvcNf2TRtAR8R6TF34lXxACXJ9EP1sFcUA=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:28.265823 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-161ae09d-2007-42c1-9f3a-f00a4cf480f5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:22:28.269637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-161ae09d-2007-42c1-9f3a-f00a4cf480f5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:22:28.368195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-161ae09d-2007-42c1-9f3a-f00a4cf480f5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124613 Jul 18 15:22:28.368941 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 531/1052] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:22:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:28.522610 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:28.525475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:28.531043 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:28.531501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:28.532297 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:28.532730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:28.565651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:28.566099 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:28.566572 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lazy-loading 'fault' on Instance uuid d4e6cc3f-8715-4d58-8c37-12d2256dc58e {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:22:28.610883 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdd71f9b93426bb6b149d2aeb2088e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c88f3beb8bf468f9a30311b203b13cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:28.619138 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e1e3464c-a4e1-442b-8998-aaef6f61b98b tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 200 len: 1224 microversion: 2.1 time: 0.100724 Jul 18 15:22:28.619716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 522/1053] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:28 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:29.640133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:29.640887 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] [instance: d4e6cc3f-8715-4d58-8c37-12d2256dc58e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:29.648641 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:29.649146 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:29.649952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:29.650392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:29.665118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] HTTP exception thrown: Instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e could not be found. Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Request method failure captured: Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e HTTP/1.1 Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XkxqwT7QY0osfVF3HVk6AcO_8MWJJbBfUydBEI3XaPZHepfE4OnLAQpW1NEz4AONLgJh26X38QoH3MnOU62YQqMIggA-3ZF9yUHfll_D3xu-0-tOeAHXfOoksnFXQWJFzFMiTE90juY9oX5U_S39R7KmZXLUutWsIOiW8XK_XFXY0Q Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 5c88f3beb8bf468f9a30311b203b13cf Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestShelveInstance-1161768023 Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:22:29.669784 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5c88f3beb8bf468f9a30311b203b13cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5c88f3beb8bf468f9a30311b203b13cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5c88f3beb8bf468f9a30311b203b13cf", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5c88f3beb8bf468f9a30311b203b13cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestShelveInstance-1161768023 Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 5c88f3beb8bf468f9a30311b203b13cf Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestShelveInstance-1161768023 Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-TestShelveInstance-1161768023-project Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: dcfdd71f9b93426bb6b149d2aeb2088e Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestShelveInstance-1161768023-project Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e could not be found. Jul 18 15:22:29.671599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': 'd4e6cc3f-8715-4d58-8c37-12d2256dc58e'} Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e could not be found. Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:22:29.672624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e could not be found. Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e could not be found. Jul 18 15:22:29.674295 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:22:29.676229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Returning 404 to user: Instance d4e6cc3f-8715-4d58-8c37-12d2256dc58e could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:22:29.676229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f93f466b-6ee7-4acb-b7b7-4bbc799e96ae tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e" status: 404 len: 111 microversion: 2.1 time: 0.034648 Jul 18 15:22:29.676229 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 532/1054] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:29 2022] GET /compute/v2.1/servers/d4e6cc3f-8715-4d58-8c37-12d2256dc58e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:22:29.946419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1a7f389d-58ff-48ad-a2fb-16bb9ecd1b65 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] Calling method '.version_select at 0x7f48c1621ca0>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:30.083007 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1a7f389d-58ff-48ad-a2fb-16bb9ecd1b65 tempest-TestShelveInstance-1161768023 tempest-TestShelveInstance-1161768023-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-483268862" status: 202 len: 0 microversion: 2.1 time: 0.141413 Jul 18 15:22:30.083603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 523/1055] 10.222.0.83 () {58 vars in 1250 bytes} [Mon Jul 18 15:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-483268862 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:22:30.751481 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-236998539", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f02ced57-ea39-45d4-8716-b5d99e92419a"}], "security_groups": [{"name": "tempest-securitygroup--391880402"}], "key_name": "tempest-keypair-843363611", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:30.864048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] validate_networks() for [('f02ced57-ea39-45d4-8716-b5d99e92419a', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:22:31.608582 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:22:31.609013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:22:31.609500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:22:31.609945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:22:31.610392 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:22:31.620492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:31.620953 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:31.621773 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:31.622220 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:31.642029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:22:31.646409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:22:31.659875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:22:31.662248 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:22:31.809579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ce344e53-25d0-4b44-ac6d-31731e582e5f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.062615 Jul 18 15:22:31.815445 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 533/1056] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:22:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:22:31.822159 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b1be1c2a-da48-406e-a02a-0ca03a4aceca tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:31.823113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b1be1c2a-da48-406e-a02a-0ca03a4aceca tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:31.909400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b1be1c2a-da48-406e-a02a-0ca03a4aceca tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:31.917738 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b1be1c2a-da48-406e-a02a-0ca03a4aceca tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1240 microversion: 2.1 time: 0.100888 Jul 18 15:22:31.918322 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 524/1057] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:31 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:32.936358 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:32.938167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:32.946525 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:32.958576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:32.958576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:32.958576 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:33.034889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:33.045579 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-39aff9b6-eec0-49c5-9314-af482e7224c8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1244 microversion: 2.1 time: 0.115024 Jul 18 15:22:33.046649 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 534/1058] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:32 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:34.062994 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:34.063583 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:34.070662 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:34.071125 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:34.071927 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:34.072375 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:34.160002 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:34.170115 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f23bfe98-2b99-44c9-853e-5c75116afa03 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1292 microversion: 2.1 time: 0.111174 Jul 18 15:22:34.170861 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 525/1059] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:34 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:35.189077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:35.189858 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:35.198411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:35.198982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:35.200355 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:35.200591 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:35.409633 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:35.418722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-de495a78-63d5-4445-9cda-b4f2eba278d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.233891 Jul 18 15:22:35.429081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 535/1060] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:35 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:36.403960 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-8801e5c9-97dc-41c3-b3c8-8230f86aa5ed req-d522006a-e004-465d-989b-83dc7af45540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0519e1a5-8427-417a-afb3-981c4819be87", "tag": "f99d3c17-347f-4f25-83a7-4016213d1497"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:36.414346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-8801e5c9-97dc-41c3-b3c8-8230f86aa5ed req-d522006a-e004-465d-989b-83dc7af45540 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:36.415232 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-8801e5c9-97dc-41c3-b3c8-8230f86aa5ed req-d522006a-e004-465d-989b-83dc7af45540 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:36.447613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:36.447613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:36.456023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-8801e5c9-97dc-41c3-b3c8-8230f86aa5ed req-d522006a-e004-465d-989b-83dc7af45540 service nova] Creating event network-changed:f99d3c17-347f-4f25-83a7-4016213d1497 for instance 0519e1a5-8427-417a-afb3-981c4819be87 on hv-cinder-83697 Jul 18 15:22:36.467522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:36.468602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:36.469437 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:36.469881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:36.475658 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-8801e5c9-97dc-41c3-b3c8-8230f86aa5ed req-d522006a-e004-465d-989b-83dc7af45540 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075902 Jul 18 15:22:36.484001 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 526/1061] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:36.821811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:36.831754 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2c67e3c4-644e-40a8-b85b-c399acb75381 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.399362 Jul 18 15:22:36.832498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 536/1062] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:36 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:22:37.852879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:37.853560 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:37.861185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:37.865561 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:37.865561 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:37.865561 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:38.028552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:38.036092 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-66df18da-52f5-4be5-a37a-0a50036669f9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.190445 Jul 18 15:22:38.037077 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 527/1063] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:37 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:39.054514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:39.055905 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:39.070677 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:39.071465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:39.072549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:39.073198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:39.396412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:39.405138 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-941cec19-f51c-45a6-8e04-0e7fa6632d21 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.355278 Jul 18 15:22:39.415380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 537/1064] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:39 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:40.424402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:40.426093 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:40.434767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:40.434767 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:40.435465 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:40.436144 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:40.580848 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:40.589688 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-72a3ac45-8d8e-4375-b75d-48acb2eb1a34 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.170054 Jul 18 15:22:40.590283 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 528/1065] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:40 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:22:41.540048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-4eb7ec9e-ffdb-435d-b06b-2cd0491a6d30 req-c3a9713a-d55a-4a36-b91c-0d55e840446c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0519e1a5-8427-417a-afb3-981c4819be87", "name": "network-vif-plugged", "status": "completed", "tag": "f99d3c17-347f-4f25-83a7-4016213d1497"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:41.550790 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-4eb7ec9e-ffdb-435d-b06b-2cd0491a6d30 req-c3a9713a-d55a-4a36-b91c-0d55e840446c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:41.554417 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-4eb7ec9e-ffdb-435d-b06b-2cd0491a6d30 req-c3a9713a-d55a-4a36-b91c-0d55e840446c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:41.563776 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-4eb7ec9e-ffdb-435d-b06b-2cd0491a6d30 req-c3a9713a-d55a-4a36-b91c-0d55e840446c service nova] Creating event network-vif-plugged:f99d3c17-347f-4f25-83a7-4016213d1497 for instance 0519e1a5-8427-417a-afb3-981c4819be87 on hv-cinder-83697 Jul 18 15:22:41.568939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-4eb7ec9e-ffdb-435d-b06b-2cd0491a6d30 req-c3a9713a-d55a-4a36-b91c-0d55e840446c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034897 Jul 18 15:22:41.570068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 538/1066] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:41.609949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:41.610727 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:41.618119 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:41.618597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:41.619632 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:41.620091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:41.833282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:41.842717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b0d8916e-cf66-4d32-9fce-d203754d8be1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.237368 Jul 18 15:22:41.843313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 529/1067] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:41 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:42.858616 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:42.859833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=10 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:42.864605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:42.865408 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:42.872691 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:42.873320 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:42.874314 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:42.874829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:43.020307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:43.030412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc6c57ad-5cbb-4f07-a3d2-204c7c558405 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1365 microversion: 2.1 time: 0.171374 Jul 18 15:22:43.030412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 539/1068] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:42 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:44.046410 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:44.047021 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:44.049053 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:22:44.054481 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:44.054978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:44.055776 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:44.056217 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:44.193113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:22:44.201443 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ecf6b1ab-514a-4ba4-b244-5fa706640957 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1555 microversion: 2.1 time: 0.159104 Jul 18 15:22:44.202016 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 530/1069] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:22:44 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:22:44.218607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:22:44.219195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:22:44.226041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:44.226623 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:44.227415 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:44.227858 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:44.308366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d2531595-ddad-4717-83e5-ba55ee4410be tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093745 Jul 18 15:22:44.308971 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 540/1070] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:22:44 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:22:45.741467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-be8b36d4-f16f-47d4-87a6-b2811c8d3117 req-349d1726-4446-4e10-b5dd-e3cbf3bb0909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0519e1a5-8427-417a-afb3-981c4819be87", "tag": "f99d3c17-347f-4f25-83a7-4016213d1497"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:22:45.751325 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-be8b36d4-f16f-47d4-87a6-b2811c8d3117 req-349d1726-4446-4e10-b5dd-e3cbf3bb0909 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:22:45.751771 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-be8b36d4-f16f-47d4-87a6-b2811c8d3117 req-349d1726-4446-4e10-b5dd-e3cbf3bb0909 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:22:45.763379 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-be8b36d4-f16f-47d4-87a6-b2811c8d3117 req-349d1726-4446-4e10-b5dd-e3cbf3bb0909 service nova] Creating event network-changed:f99d3c17-347f-4f25-83a7-4016213d1497 for instance 0519e1a5-8427-417a-afb3-981c4819be87 on hv-cinder-83697 Jul 18 15:22:45.769509 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-be8b36d4-f16f-47d4-87a6-b2811c8d3117 req-349d1726-4446-4e10-b5dd-e3cbf3bb0909 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031546 Jul 18 15:22:45.770080 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 531/1071] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:18.379885 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:18.380693 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:18.384829 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-184049308", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577847118", "security_groups": [{"name": "tempest-secgroup-smoke-606153650"}], "block_device_mapping_v2": [{"uuid": "1e58e8f9-4ca5-4484-8f33-3f61f3392337", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dccabfdf-5758-41b0-add6-21d121e89ad0"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:18.544644 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] validate_networks() for [('dccabfdf-5758-41b0-add6-21d121e89ad0', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:23:19.202424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:23:19.202886 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:23:19.203469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:23:19.203901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:23:19.204326 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:23:19.214498 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:19.214991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:19.215817 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:19.216500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:19.235489 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for project 94513773e0c94187bbdaeb82c7304eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:23:19.239785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Getting quotas for user 6bfa2a00688d4eab993059ff176d8920 and project 94513773e0c94187bbdaeb82c7304eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:23:19.300769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:23:19.303586 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e58e8f9-4ca5-4484-8f33-3f61f3392337',volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:23:19.698464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1ae91400-639b-4dfc-b40c-5190419318c2 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.319932 Jul 18 15:23:19.699438 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 541/1072] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:23:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:23:19.707287 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:19.708336 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:19.712719 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-23c35945-9089-4eb4-803e-ffd0e223b5d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:19.713423 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-23c35945-9089-4eb4-803e-ffd0e223b5d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:19.774740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-23c35945-9089-4eb4-803e-ffd0e223b5d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:19.782254 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-23c35945-9089-4eb4-803e-ffd0e223b5d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1093 microversion: 2.1 time: 0.076603 Jul 18 15:23:19.782867 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 532/1073] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:19 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:20.801378 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:20.802045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:20.809655 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:20.810115 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:20.810930 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:20.811376 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:20.875802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:20.884269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4a0fd27c-00a7-4bb7-a7ca-6ce06025de17 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1143 microversion: 2.1 time: 0.087639 Jul 18 15:23:20.884853 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 542/1074] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:20 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:21.901861 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:21.902480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:21.911244 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:21.911716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:21.913363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:21.913570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:21.978850 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:21.987696 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-92d33fa0-1feb-4f98-8c27-81da92ef3253 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1143 microversion: 2.1 time: 0.089612 Jul 18 15:23:21.995917 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 533/1075] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:21 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:23.006407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:23.007212 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:23.013875 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:23.014403 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:23.015265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:23.015715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:23.323079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:23.332104 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d5d0569-6de0-4ea6-ac7e-aa3c931fa5fa tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1191 microversion: 2.1 time: 0.330000 Jul 18 15:23:23.339939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 543/1076] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:23 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1191 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:24.352637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:24.356535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:24.360842 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:24.361457 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:24.362248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:24.362751 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:24.506553 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:24.514693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0a31574b-1cdb-4390-a7c3-3a2c368d44ad tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1276 microversion: 2.1 time: 0.169070 Jul 18 15:23:24.515286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 534/1077] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:24 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:25.015999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-099aed56-9bc5-426d-bb43-3bc9f10132b5 req-2e33c099-190e-445d-a2f2-4f27bfd6bf55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3feb2f04-59a7-4448-8257-05e5a4a11339", "tag": "678d7454-42c1-4085-96bc-75e20add8cf4"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:25.027074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-099aed56-9bc5-426d-bb43-3bc9f10132b5 req-2e33c099-190e-445d-a2f2-4f27bfd6bf55 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:25.027675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-099aed56-9bc5-426d-bb43-3bc9f10132b5 req-2e33c099-190e-445d-a2f2-4f27bfd6bf55 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:25.042696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-099aed56-9bc5-426d-bb43-3bc9f10132b5 req-2e33c099-190e-445d-a2f2-4f27bfd6bf55 service nova] Creating event network-changed:678d7454-42c1-4085-96bc-75e20add8cf4 for instance 3feb2f04-59a7-4448-8257-05e5a4a11339 on hv-cinder-83697 Jul 18 15:23:25.048074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-099aed56-9bc5-426d-bb43-3bc9f10132b5 req-2e33c099-190e-445d-a2f2-4f27bfd6bf55 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037635 Jul 18 15:23:25.048933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 544/1078] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:25.533313 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:25.533938 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:25.542346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:25.542950 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:25.544451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:25.544899 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:25.720862 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:25.731345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bfa3dbe1-524e-4a16-9ab3-f4c05211dc28 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.200645 Jul 18 15:23:25.731345 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 535/1079] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:25 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:26.748415 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:26.749116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:26.756630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:26.757011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:26.757788 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:26.758226 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:26.896305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:26.904173 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-62f6cb6c-452b-4039-9d0b-33696966247e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.160066 Jul 18 15:23:26.904763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 545/1080] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:26 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:27.921037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:27.921671 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:27.929285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:27.929285 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:27.929913 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:27.930349 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:28.071930 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:28.080028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-17ba87d7-a0f4-439f-9b9a-a7af015c9615 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.163018 Jul 18 15:23:28.080600 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 536/1081] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:27 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:29.097762 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:29.099261 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:29.106339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.106833 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.107630 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.108108 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.226385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:29.247048 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:29.251807 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:29.259666 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-17b67b89-6ca5-4ad4-aa3a-68f6b9c49444 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.166133 Jul 18 15:23:29.260779 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 546/1082] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:29 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:29.530306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:29.530879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:29.537745 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.538385 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.539273 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.539816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.566365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a2e7d958-2844-453a-8c15-155e5a17c484 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/ips" status: 200 len: 149 microversion: 2.1 time: 0.040420 Jul 18 15:23:29.567053 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 537/1083] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:23:29 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:29.578922 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aedf622-caac-4d02-878e-c2b0329318b9"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:29.580167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:29.588461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.588936 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.589728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.590178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.675066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Invalid volume: volume 2aedf622-caac-4d02-878e-c2b0329318b9 is already attached to instances: 21494892-e0fd-4cd0-b274-4303d90e7817 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: POST /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/os-volume_attachments HTTP/1.1 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 74 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:23:29.677156 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {"volumeAttachment": {"volumeId": "2aedf622-caac-4d02-878e-c2b0329318b9"}} Jul 18 15:23:29.679085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Invalid volume: volume 2aedf622-caac-4d02-878e-c2b0329318b9 is already attached to instances: 21494892-e0fd-4cd0-b274-4303d90e7817 Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'server_id': '0519e1a5-8427-417a-afb3-981c4819be87', 'body': {'volumeAttachment': {'volumeId': '2aedf622-caac-4d02-878e-c2b0329318b9'}}} Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2aedf622-caac-4d02-878e-c2b0329318b9 is already attached to instances: 21494892-e0fd-4cd0-b274-4303d90e7817 Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:23:29.679991 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2aedf622-caac-4d02-878e-c2b0329318b9 is already attached to instances: 21494892-e0fd-4cd0-b274-4303d90e7817 Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:29.682031 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2aedf622-caac-4d02-878e-c2b0329318b9 is already attached to instances: 21494892-e0fd-4cd0-b274-4303d90e7817 Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 400 to user: Invalid volume: volume 2aedf622-caac-4d02-878e-c2b0329318b9 is already attached to instances: 21494892-e0fd-4cd0-b274-4303d90e7817 {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-56c43eb4-48d6-4492-a11c-5d7562332207 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106728 Jul 18 15:23:29.685982 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 547/1084] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:23:29 2022] POST /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:23:29.692414 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:29.692811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:29.699598 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.700056 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.700832 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:29.701263 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:29.729571 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:23:29.779004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:30.036339 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d209284b-1d56-439a-9d90-c2a0cbc618f1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 204 len: 0 microversion: 2.1 time: 0.347682 Jul 18 15:23:30.037009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 538/1085] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:23:29 2022] DELETE /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:23:30.046005 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:30.046663 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:30.053652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:30.054116 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:30.054938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:30.055383 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:30.220376 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:30.229694 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b90849da-bc13-46d3-99d4-2190de19493d tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1679 microversion: 2.1 time: 0.187986 Jul 18 15:23:30.230287 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 548/1086] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:30 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:30.277785 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:30.278523 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:30.284818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:30.285579 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:30.286378 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:30.287845 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:30.597272 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:30.604517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-54f161e1-7621-4f64-96ba-3b65ec1a8362 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.331167 Jul 18 15:23:30.605085 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 539/1087] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:30 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:31.247349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:31.249463 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:31.254717 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:31.255180 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:31.256592 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:31.257050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:31.393123 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:31.400871 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b0797008-4529-4a51-89a8-7f9bf4e2425f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1679 microversion: 2.1 time: 0.157634 Jul 18 15:23:31.401459 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 549/1088] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:31 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:31.622823 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:31.623409 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:31.630054 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:31.630710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:31.632146 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:31.632592 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:31.770975 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:31.779487 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a4072bd3-a3d3-4d63-b26b-a5ca4f414dcd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.160791 Jul 18 15:23:31.780168 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 540/1089] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:31 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:32.418410 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:32.419661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:32.429247 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:32.434335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:32.434335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:32.434335 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:32.797690 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:32.798406 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:32.805835 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:32.806311 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:32.807129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:32.807586 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:32.962973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:32.968924 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:32.971084 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7a432e5a-4541-44e2-b011-0c9c9d79f996 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.177324 Jul 18 15:23:32.975520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 541/1090] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:32 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:23:32.989118 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5546266d-24e3-4c95-bb69-3d640eb3e62f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1679 microversion: 2.1 time: 0.574847 Jul 18 15:23:32.989806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 550/1091] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:32 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1679 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:33.512580 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-90b33b51-1d10-4b3e-a358-ea4af3620c22 req-81557138-4123-46e4-9f44-863e1f3a7673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0519e1a5-8427-417a-afb3-981c4819be87", "name": "network-vif-deleted", "tag": "f99d3c17-347f-4f25-83a7-4016213d1497"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:33.520893 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-90b33b51-1d10-4b3e-a358-ea4af3620c22 req-81557138-4123-46e4-9f44-863e1f3a7673 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:33.522015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-90b33b51-1d10-4b3e-a358-ea4af3620c22 req-81557138-4123-46e4-9f44-863e1f3a7673 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:33.533643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-90b33b51-1d10-4b3e-a358-ea4af3620c22 req-81557138-4123-46e4-9f44-863e1f3a7673 service nova] Creating event network-vif-deleted:f99d3c17-347f-4f25-83a7-4016213d1497 for instance 0519e1a5-8427-417a-afb3-981c4819be87 on hv-cinder-83697 Jul 18 15:23:33.539025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-90b33b51-1d10-4b3e-a358-ea4af3620c22 req-81557138-4123-46e4-9f44-863e1f3a7673 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030147 Jul 18 15:23:33.540226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 542/1092] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:33.989464 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:33.991119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:33.998303 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:33.998881 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:33.999861 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:34.000371 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:34.009074 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:34.009908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:34.018246 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:34.018571 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:34.019374 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:34.019822 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:34.058317 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:34.059010 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:34.059732 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lazy-loading 'fault' on Instance uuid 0519e1a5-8427-417a-afb3-981c4819be87 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:23:34.109517 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:34.119866 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-381fc220-9d55-42be-aac1-f85043652526 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 200 len: 1330 microversion: 2.1 time: 0.115886 Jul 18 15:23:34.120912 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 543/1093] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:34 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:23:34.175085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:34.182425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a217c8f2-bc01-47e7-b5d7-804752a5df4b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.196933 Jul 18 15:23:34.183456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 551/1094] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:33 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:35.138223 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:35.138890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:35.145535 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:35.160714 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:35.160714 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:35.160714 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:35.161201 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 HTTP/1.1 Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:23:35.163065 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:23:35.164888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '0519e1a5-8427-417a-afb3-981c4819be87'} Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:23:35.166106 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:23:35.167797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:35.169320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:23:35.169320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-1a080aab-18e9-4656-ace0-4dba823174a7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 404 len: 111 microversion: 2.1 time: 0.030399 Jul 18 15:23:35.169320 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 544/1095] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:35 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:23:35.173571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-62e07d81-1484-42cb-9332-bce40dc62c16 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '.version_select at 0x7f48c1e21550>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:35.200508 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:35.201162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:35.207347 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:35.207796 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:35.208558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:35.209194 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:35.252318 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-62e07d81-1484-42cb-9332-bce40dc62c16 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843363611" status: 202 len: 0 microversion: 2.1 time: 0.082551 Jul 18 15:23:35.252923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 552/1096] 10.222.0.83 () {58 vars in 1217 bytes} [Mon Jul 18 15:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843363611 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:23:35.356147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:35.363913 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4d641b9f-b016-43c7-a314-a5127d682e84 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.167490 Jul 18 15:23:35.364554 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 545/1097] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:35 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:23:35.816604 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-b9803518-5de3-412a-afa2-9661064a0359 req-891ac900-2a08-44d1-a1a0-9ae25c1c1669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3feb2f04-59a7-4448-8257-05e5a4a11339", "name": "network-vif-plugged", "status": "completed", "tag": "678d7454-42c1-4085-96bc-75e20add8cf4"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:35.827506 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b9803518-5de3-412a-afa2-9661064a0359 req-891ac900-2a08-44d1-a1a0-9ae25c1c1669 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:35.827967 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b9803518-5de3-412a-afa2-9661064a0359 req-891ac900-2a08-44d1-a1a0-9ae25c1c1669 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:35.841249 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-b9803518-5de3-412a-afa2-9661064a0359 req-891ac900-2a08-44d1-a1a0-9ae25c1c1669 service nova] Creating event network-vif-plugged:678d7454-42c1-4085-96bc-75e20add8cf4 for instance 3feb2f04-59a7-4448-8257-05e5a4a11339 on hv-cinder-83697 Jul 18 15:23:35.847165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-b9803518-5de3-412a-afa2-9661064a0359 req-891ac900-2a08-44d1-a1a0-9ae25c1c1669 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034612 Jul 18 15:23:35.848340 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 553/1098] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:36.179424 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:36.180037 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:36.186192 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:36.186693 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:36.187477 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:36.187917 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:36.272277 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lazy-loading 'services' on Instance uuid 21494892-e0fd-4cd0-b274-4303d90e7817 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:23:36.382516 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:36.383256 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:36.390492 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:36.390956 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:36.391733 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:36.392178 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:36.533386 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:36.541850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-793f4ba0-1d0d-42cc-80d4-bf135d93c1d4 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1264 microversion: 2.1 time: 0.164021 Jul 18 15:23:36.542485 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 554/1099] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:36 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:23:36.553775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-30cbe653-508d-45a1-9986-cd30e0cf4f68 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments/2aedf622-caac-4d02-878e-c2b0329318b9" status: 202 len: 0 microversion: 2.1 time: 0.379617 Jul 18 15:23:36.554366 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 546/1100] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:23:36 2022] DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments/2aedf622-caac-4d02-878e-c2b0329318b9 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:23:36.567283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:36.568296 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:36.574675 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:36.575138 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:36.575933 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:36.576423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:36.607654 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ed3079ea-9b0f-4292-a3ff-d60b3f6d564e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Jul 18 15:23:36.608225 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 555/1101] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:23:36 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:37.560582 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:37.561282 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:37.567695 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:37.568746 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:37.569533 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:37.569989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:37.619862 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:37.620963 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:37.627742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:37.628195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:37.629030 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:37.629513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:37.661172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7856b35c-1240-48fb-9841-9fabeeccdb35 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Jul 18 15:23:37.662366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 556/1102] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:23:37 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:23:37.711049 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:37.720244 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-b652b42a-c0e4-4b28-902c-30d71a6506a3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1452 microversion: 2.1 time: 0.164630 Jul 18 15:23:37.720838 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 547/1103] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:37 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:37.740821 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:37.741455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:37.749405 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:37.749973 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:37.750905 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:37.751433 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:37.892952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:37.902202 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-91ae6a97-56f5-4de5-8895-0cb0f6b82c24 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1452 microversion: 2.1 time: 0.165509 Jul 18 15:23:37.902202 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 557/1104] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:37 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:38.674229 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:38.675220 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:38.682258 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:38.682764 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:38.683589 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:38.684039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:38.701892 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:38.715941 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-12624b17-8d05-44e5-bcaa-51b649521811 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045905 Jul 18 15:23:38.716519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 548/1105] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:23:38 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:23:38.780253 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:38.780849 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:38.787739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:38.788430 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:38.791313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:38.791313 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:38.820549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:23:38.972937 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:39.156771 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6c0079dd-d0c6-4aae-8e5e-671b75b9a35a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 204 len: 0 microversion: 2.1 time: 0.380281 Jul 18 15:23:39.157402 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 558/1106] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:23:38 2022] DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:23:39.166939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:39.167702 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:39.175386 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:39.176196 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:39.177200 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:39.178284 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:39.367449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:39.375026 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-74409e05-2ba8-4e66-aa83-b4d4aae214c7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1682 microversion: 2.1 time: 0.213069 Jul 18 15:23:39.375609 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 549/1107] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:39 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:40.076840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-2f682132-2d16-489f-b685-92e32a1a1a2b req-3472635d-3301-48d6-8d22-4971aa68e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3feb2f04-59a7-4448-8257-05e5a4a11339", "tag": "678d7454-42c1-4085-96bc-75e20add8cf4"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:40.086864 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-2f682132-2d16-489f-b685-92e32a1a1a2b req-3472635d-3301-48d6-8d22-4971aa68e2dc service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:40.087314 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-2f682132-2d16-489f-b685-92e32a1a1a2b req-3472635d-3301-48d6-8d22-4971aa68e2dc service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:40.099516 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-2f682132-2d16-489f-b685-92e32a1a1a2b req-3472635d-3301-48d6-8d22-4971aa68e2dc service nova] Creating event network-changed:678d7454-42c1-4085-96bc-75e20add8cf4 for instance 3feb2f04-59a7-4448-8257-05e5a4a11339 on hv-cinder-83697 Jul 18 15:23:40.105249 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-2f682132-2d16-489f-b685-92e32a1a1a2b req-3472635d-3301-48d6-8d22-4971aa68e2dc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034203 Jul 18 15:23:40.105873 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 559/1108] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:40.393359 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:40.394097 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:40.402074 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:40.402529 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:40.403339 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:40.403773 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:40.547875 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:40.555697 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-db022fa9-1b92-4264-bd7a-112bc51809d2 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1682 microversion: 2.1 time: 0.166745 Jul 18 15:23:40.556292 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 550/1109] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:40 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:41.575214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:41.575795 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:41.582486 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:41.586452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:41.586452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:41.586452 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:41.727100 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:41.734743 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6c03aeb0-48b5-4ab7-bda0-c8ba00314cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1682 microversion: 2.1 time: 0.164968 Jul 18 15:23:41.735325 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 560/1110] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:41 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:42.752401 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:42.753009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:42.760763 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:42.761211 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:42.761986 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:42.762437 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:42.936920 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:42.945890 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-5a3ae3b2-33bc-4517-b399-a2262e987049 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1682 microversion: 2.1 time: 0.197662 Jul 18 15:23:42.949973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 551/1111] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:42 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:43.963595 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:43.964169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:43.971500 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:43.972213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:43.973563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:43.973563 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:44.048697 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:44.058417 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1610360d-5317-4c7f-ab80-54ca9ae24a6f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1614 microversion: 2.1 time: 0.099053 Jul 18 15:23:44.059103 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 561/1112] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:43 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:44.357815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-af3eddd2-8227-445d-a842-585e93fd3597 req-f180797d-9381-42c8-9df3-7b67acb28e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21494892-e0fd-4cd0-b274-4303d90e7817", "name": "network-vif-deleted", "tag": "665511ed-7023-40e9-b6f7-da66ba4c98ed"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:44.379754 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-af3eddd2-8227-445d-a842-585e93fd3597 req-f180797d-9381-42c8-9df3-7b67acb28e93 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:44.380627 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-af3eddd2-8227-445d-a842-585e93fd3597 req-f180797d-9381-42c8-9df3-7b67acb28e93 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:44.398003 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-af3eddd2-8227-445d-a842-585e93fd3597 req-f180797d-9381-42c8-9df3-7b67acb28e93 service nova] Creating event network-vif-deleted:665511ed-7023-40e9-b6f7-da66ba4c98ed for instance 21494892-e0fd-4cd0-b274-4303d90e7817 on hv-cinder-83697 Jul 18 15:23:44.405008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-af3eddd2-8227-445d-a842-585e93fd3597 req-f180797d-9381-42c8-9df3-7b67acb28e93 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052382 Jul 18 15:23:44.405816 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 552/1113] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:23:45.077902 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:45.078519 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:45.088024 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:45.088781 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:45.089638 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:45.090092 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:45.124914 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:45.125373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:45.125837 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lazy-loading 'fault' on Instance uuid 21494892-e0fd-4cd0-b274-4303d90e7817 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:23:45.172557 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:45.181227 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-73f65ce3-50ca-4416-8f70-c2e000617bfc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 200 len: 1331 microversion: 2.1 time: 0.108273 Jul 18 15:23:45.182567 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 562/1114] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:45 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:46.200305 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:46.200956 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:46.208062 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:46.208515 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:46.209315 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:46.209833 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:46.226503 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 HTTP/1.1 Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:23:46.228235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:23:46.229831 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '21494892-e0fd-4cd0-b274-4303d90e7817'} Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:23:46.230721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:23:46.232431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:23:46.233908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:23:46.233908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-48ddcea0-22d5-4a8a-8fbc-b147ae2bd6af tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 404 len: 111 microversion: 2.1 time: 0.034100 Jul 18 15:23:46.233908 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 553/1115] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:46 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 15:23:46.239412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7e8daa8a-e0d1-42aa-b064-7d5661760bca tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '.version_select at 0x7f48c1e21310>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:46.352068 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7e8daa8a-e0d1-42aa-b064-7d5661760bca tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131517230" status: 202 len: 0 microversion: 2.1 time: 0.116614 Jul 18 15:23:46.352679 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 563/1116] 10.222.0.83 () {58 vars in 1220 bytes} [Mon Jul 18 15:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131517230 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:23:47.178567 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8b13da4f-926b-48b2-9c67-27a6f3828f51 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: .version_select at 0x7f48c1937a60>, body: {"keypair": {"name": "tempest-keypair-1593019249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGDr20f3hw8YCt7t4IPcmiZOI+m1ckLA3n/jzA0fIiDTy1F0qQtBYp31ZkGkbrU8C3Hag0IpacShvxGxUhyK3eWzeNIgvmuFzhGst1hgI2nkHC6vpPIWV2fa1Fy1dR0lA=="}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:47.193964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-8b13da4f-926b-48b2-9c67-27a6f3828f51 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:23:47.198111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-8b13da4f-926b-48b2-9c67-27a6f3828f51 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:23:47.335377 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8b13da4f-926b-48b2-9c67-27a6f3828f51 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160203 Jul 18 15:23:47.336111 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 554/1117] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:23:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:50.238481 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-405808314", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f02ced57-ea39-45d4-8716-b5d99e92419a"}], "security_groups": [{"name": "tempest-securitygroup--1281542549"}], "key_name": "tempest-keypair-1593019249", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:50.245377 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:50.352474 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] validate_networks() for [('f02ced57-ea39-45d4-8716-b5d99e92419a', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:23:50.762133 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:23:50.768412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:23:50.768412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:23:50.768412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:23:50.768412 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:23:50.772321 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:23:50.773749 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:23:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:23:50.773865 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:50.773984 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:50.774782 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:50.775372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:50.793986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:23:50.798085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:23:50.810159 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:23:50.812653 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:23:51.022834 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f2c83a6e-3cea-4e4c-8402-98f93e855cbf tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.789105 Jul 18 15:23:51.023919 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 564/1118] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:23:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:23:51.035060 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8b5eec59-07b6-405a-85d8-4698a9af597a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:51.035646 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8b5eec59-07b6-405a-85d8-4698a9af597a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:51.097223 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8b5eec59-07b6-405a-85d8-4698a9af597a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:51.104462 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8b5eec59-07b6-405a-85d8-4698a9af597a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1241 microversion: 2.1 time: 0.074147 Jul 18 15:23:51.105061 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 555/1119] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:51 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:52.121647 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:52.122384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:52.130775 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:52.131258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:52.133015 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:52.133471 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:52.198293 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:52.206254 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-87789a79-5f60-42c1-ba12-6518c8993580 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1245 microversion: 2.1 time: 0.088739 Jul 18 15:23:52.206876 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 565/1120] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:52 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:53.225610 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:53.226226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:53.233780 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:53.245795 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:53.245795 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:53.245795 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:53.305358 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:53.314057 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-8e766d20-754c-4da8-935a-62525666c151 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1293 microversion: 2.1 time: 0.093499 Jul 18 15:23:53.314818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 556/1121] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:53 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:54.332600 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:54.334034 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:54.344851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:54.344851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:54.344851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:54.344851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:54.527041 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:54.538805 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8bc18d0f-0740-4ac4-b387-a7a7530e21d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.210528 Jul 18 15:23:54.539715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 566/1122] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:54 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:55.241838 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-c2209be9-bd15-4302-bbf4-d34a33d5867a req-350662de-70c9-4bc3-af91-f277c340d82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f397bb-a27c-4951-b40d-745f5ecd0c63", "tag": "d8f02028-6f11-425b-9a1d-4777db590b55"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:55.247725 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:23:55.254092 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-c2209be9-bd15-4302-bbf4-d34a33d5867a req-350662de-70c9-4bc3-af91-f277c340d82a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:55.255040 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-c2209be9-bd15-4302-bbf4-d34a33d5867a req-350662de-70c9-4bc3-af91-f277c340d82a service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:55.268729 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-c2209be9-bd15-4302-bbf4-d34a33d5867a req-350662de-70c9-4bc3-af91-f277c340d82a service nova] Creating event network-changed:d8f02028-6f11-425b-9a1d-4777db590b55 for instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 on hv-cinder-83697 Jul 18 15:23:55.273872 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-c2209be9-bd15-4302-bbf4-d34a33d5867a req-350662de-70c9-4bc3-af91-f277c340d82a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035668 Jul 18 15:23:55.274804 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 557/1123] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:23:55.559522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:55.560255 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:55.567674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:55.568136 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:55.568997 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:55.569491 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:55.727453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:55.737752 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b06cabf5-6282-4dd2-9da3-66cc754032aa tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.183871 Jul 18 15:23:55.746135 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 567/1124] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:55 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:23:56.758766 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:56.759500 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:56.767027 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:56.767485 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:56.768271 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:56.768716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:56.906694 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:56.914452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-50dd7749-fcf8-4d06-b37e-ac80f2fe7062 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.160923 Jul 18 15:23:56.915382 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 558/1125] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:56 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:57.932599 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:57.933302 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:57.940314 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:57.941487 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:57.942656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:57.942999 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:58.088923 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:58.098186 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5f9287a8-513c-4ebf-9fea-4140909ff54c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.169850 Jul 18 15:23:58.099167 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 568/1126] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:57 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:59.116628 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:23:59.117266 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:23:59.124775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:59.125228 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:59.126995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:59.127260 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:59.274409 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:23:59.287245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-f2bfbc54-58d4-418a-ac43-328b50e1bc3a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.174692 Jul 18 15:23:59.287860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 559/1127] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:23:59 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:23:59.921336 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-88d20a7d-07ce-4988-9e14-14e4d170575e req-f9f7f1b0-0d1d-4f77-aae8-a16620be021f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f397bb-a27c-4951-b40d-745f5ecd0c63", "name": "network-vif-plugged", "status": "completed", "tag": "d8f02028-6f11-425b-9a1d-4777db590b55"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:23:59.932705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-88d20a7d-07ce-4988-9e14-14e4d170575e req-f9f7f1b0-0d1d-4f77-aae8-a16620be021f service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:23:59.932705 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-88d20a7d-07ce-4988-9e14-14e4d170575e req-f9f7f1b0-0d1d-4f77-aae8-a16620be021f service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:23:59.943930 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-88d20a7d-07ce-4988-9e14-14e4d170575e req-f9f7f1b0-0d1d-4f77-aae8-a16620be021f service nova] Creating event network-vif-plugged:d8f02028-6f11-425b-9a1d-4777db590b55 for instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 on hv-cinder-83697 Jul 18 15:23:59.949107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-88d20a7d-07ce-4988-9e14-14e4d170575e req-f9f7f1b0-0d1d-4f77-aae8-a16620be021f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 Jul 18 15:23:59.949787 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 569/1128] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 15:24:00.306008 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:00.306666 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:00.314264 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:00.314737 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:00.315558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:00.315978 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:00.485641 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:00.493229 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e1ff4917-245f-4d8e-83b3-b22678b43b81 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.191113 Jul 18 15:24:00.493818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 560/1129] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:00 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:01.517013 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:01.517721 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:01.519748 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:01.520425 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:01.526020 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:01.526473 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:01.527294 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:01.527742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:01.668898 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:01.677659 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4bc35541-6b5d-480a-b158-541ec6696818 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1367 microversion: 2.1 time: 0.164902 Jul 18 15:24:01.678269 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 570/1130] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:01 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:02.695747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:02.696396 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:02.698494 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:02.704612 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:02.705075 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:02.705852 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:02.706295 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:02.852658 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:02.860520 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-53ae2e21-5f0f-4a61-8402-dc2a46b48dff tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1557 microversion: 2.1 time: 0.168755 Jul 18 15:24:02.863949 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 561/1131] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:02 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:02.877935 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:02.878455 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:02.885197 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:02.885674 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:02.886461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:02.886945 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:02.967844 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-83efdba4-e439-4359-bad6-f8bb337c96c1 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094768 Jul 18 15:24:02.968450 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 571/1132] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:24:02 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:04.278573 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-8c4e3d8c-6d6d-4691-b309-c8478095eed7 req-d162244d-b3dd-458e-825b-326aec6d99c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f397bb-a27c-4951-b40d-745f5ecd0c63", "tag": "d8f02028-6f11-425b-9a1d-4777db590b55"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:24:04.285755 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-8c4e3d8c-6d6d-4691-b309-c8478095eed7 req-d162244d-b3dd-458e-825b-326aec6d99c2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:04.286223 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-8c4e3d8c-6d6d-4691-b309-c8478095eed7 req-d162244d-b3dd-458e-825b-326aec6d99c2 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:04.297964 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-8c4e3d8c-6d6d-4691-b309-c8478095eed7 req-d162244d-b3dd-458e-825b-326aec6d99c2 service nova] Creating event network-changed:d8f02028-6f11-425b-9a1d-4777db590b55 for instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 on hv-cinder-83697 Jul 18 15:24:04.303225 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-8c4e3d8c-6d6d-4691-b309-c8478095eed7 req-d162244d-b3dd-458e-825b-326aec6d99c2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030231 Jul 18 15:24:04.303944 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 562/1133] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:37.293162 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:37.294079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=60 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:37.298069 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:37.298587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:37.305835 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:37.309508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:37.309508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:37.309508 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:37.332827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d38bcff0-ee47-42a5-b913-f0184ae3edf0 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/ips" status: 200 len: 149 microversion: 2.1 time: 0.041130 Jul 18 15:24:37.333435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 572/1134] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:24:37 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:39.112976 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=11 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:39.113823 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=58 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:24:39.118218 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:24:39.119408 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:39.126202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:39.126703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:39.127489 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:39.127924 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:39.941812 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c13b3364-40d2-46c7-879f-65b10e99a3fc tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830459 Jul 18 15:24:39.942447 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 563/1135] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:24:39 2022] POST /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:47.441816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:24:47.442931 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:47.450778 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:47.451238 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:47.452008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:47.452444 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:47.534056 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Invalid volume: volume d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 is already attached to instances: 82f397bb-a27c-4951-b40d-745f5ecd0c63 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: POST /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments HTTP/1.1 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 74 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:24:47.535859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {"volumeAttachment": {"volumeId": "d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935"}} Jul 18 15:24:47.537628 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Invalid volume: volume d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 is already attached to instances: 82f397bb-a27c-4951-b40d-745f5ecd0c63 Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'server_id': '82f397bb-a27c-4951-b40d-745f5ecd0c63', 'body': {'volumeAttachment': {'volumeId': 'd9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935'}}} Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 is already attached to instances: 82f397bb-a27c-4951-b40d-745f5ecd0c63 Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:47.538518 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 is already attached to instances: 82f397bb-a27c-4951-b40d-745f5ecd0c63 Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:24:47.539952 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 is already attached to instances: 82f397bb-a27c-4951-b40d-745f5ecd0c63 Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 400 to user: Invalid volume: volume d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 is already attached to instances: 82f397bb-a27c-4951-b40d-745f5ecd0c63 {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a0e08f2c-7cab-4674-819a-29cde98b219e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100293 Jul 18 15:24:47.541316 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 573/1136] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:24:47 2022] POST /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:24:47.601569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:47.602191 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:47.609140 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:47.609597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:47.610391 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:47.610874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:47.695840 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lazy-loading 'services' on Instance uuid 82f397bb-a27c-4951-b40d-745f5ecd0c63 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:24:47.957874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9b9a65c6-fee4-4be7-bfb1-f3ae3ddc9f4e tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments/d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935" status: 202 len: 0 microversion: 2.1 time: 0.361355 Jul 18 15:24:47.958596 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 564/1137] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:24:47 2022] DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments/d9dec19d-bf54-4bf1-a5f4-cb6fa5a6f935 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:24:47.968636 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:47.970045 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:47.977367 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:47.977816 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:47.978644 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:47.979066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:48.010901 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6298cb70-2cc4-4e61-a2db-045e8c7a9214 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Jul 18 15:24:48.011462 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 574/1138] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:24:47 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:49.024105 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:49.025180 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:49.032206 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:49.032663 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:49.033438 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:49.033879 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:49.063552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a3b04564-7a3e-47b0-862e-c7a856484c92 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044311 Jul 18 15:24:49.064114 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 565/1139] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:24:49 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:24:49.128783 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:49.129384 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:49.135964 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:49.136404 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:49.138081 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:49.138526 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:49.164339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:24:49.493003 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c8e2a31-c4d7-4a6e-8c8c-92ca3d61cf2b tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 204 len: 0 microversion: 2.1 time: 0.367645 Jul 18 15:24:49.493769 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 575/1140] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:24:49 2022] DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:24:49.503232 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:49.503889 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:49.510188 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:49.510708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:49.511544 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:49.512173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:49.665740 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:49.674594 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-65772bad-3db7-46ce-b46e-01bfaef95178 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1681 microversion: 2.1 time: 0.175458 Jul 18 15:24:49.675179 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 566/1141] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:49 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:50.694165 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:50.694909 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:50.702453 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:50.702932 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:50.703725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:50.704169 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:50.842660 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:50.850609 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ede29093-e322-45a0-864b-a3a9ef725676 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1681 microversion: 2.1 time: 0.160763 Jul 18 15:24:50.851195 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 576/1142] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:50 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:51.868383 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:51.869013 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:51.877157 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:51.877747 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:51.878574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:51.879035 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:51.954935 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:51.964603 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-55271351-988f-40e1-b65c-c3d77bb80037 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1613 microversion: 2.1 time: 0.100150 Jul 18 15:24:51.965475 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 567/1143] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:51 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:52.241940 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-6c85061e-b7be-4c08-b0d8-2ac175803807 req-36cd777e-958f-432c-af0b-56f04f7d3825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f397bb-a27c-4951-b40d-745f5ecd0c63", "name": "network-vif-deleted", "tag": "d8f02028-6f11-425b-9a1d-4777db590b55"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:24:52.252359 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-6c85061e-b7be-4c08-b0d8-2ac175803807 req-36cd777e-958f-432c-af0b-56f04f7d3825 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:52.252811 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-6c85061e-b7be-4c08-b0d8-2ac175803807 req-36cd777e-958f-432c-af0b-56f04f7d3825 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:52.265467 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-6c85061e-b7be-4c08-b0d8-2ac175803807 req-36cd777e-958f-432c-af0b-56f04f7d3825 service nova] Creating event network-vif-deleted:d8f02028-6f11-425b-9a1d-4777db590b55 for instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 on hv-cinder-83697 Jul 18 15:24:52.270955 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-6c85061e-b7be-4c08-b0d8-2ac175803807 req-36cd777e-958f-432c-af0b-56f04f7d3825 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255897 Jul 18 15:24:52.271884 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 577/1144] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:52.989645 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:52.990379 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:52.999028 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:52.999509 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:53.000303 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:53.000748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:53.036640 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:53.037108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:53.037558 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lazy-loading 'fault' on Instance uuid 82f397bb-a27c-4951-b40d-745f5ecd0c63 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:24:53.084207 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:53.091785 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6312a857-8ec8-4e14-a9fd-106cc4ecada6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 200 len: 1331 microversion: 2.1 time: 0.106212 Jul 18 15:24:53.092557 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 568/1145] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:52 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:54.116942 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:54.117740 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:54.124626 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:54.129398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:54.129398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:54.129398 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:54.141859 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 HTTP/1.1 Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:24:54.143554 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:24:54.145380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '82f397bb-a27c-4951-b40d-745f5ecd0c63'} Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:24:54.146681 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:24:54.148350 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:24:54.149915 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:24:54.149915 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0bde1442-5376-43dd-ae9e-f8119cdf7e65 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 404 len: 111 microversion: 2.1 time: 0.032941 Jul 18 15:24:54.149915 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 578/1146] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:54 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:24:54.154389 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c316d063-527d-4f1f-9fbc-22db879d2e45 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '.version_select at 0x7f48c1937e50>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:54.252716 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c316d063-527d-4f1f-9fbc-22db879d2e45 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593019249" status: 202 len: 0 microversion: 2.1 time: 0.102429 Jul 18 15:24:54.253306 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 569/1147] 10.222.0.83 () {58 vars in 1220 bytes} [Mon Jul 18 15:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593019249 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:24:55.319805 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fae5e505-524f-46eb-98f3-1b21bf384e93 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: .version_select at 0x7f48c1db25e0>, body: {"keypair": {"name": "tempest-keypair-1464394003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlDUtH4RVFH4IymxrIcY7ucHfme+0VqO3z2FwnIJCBV8VOUNIOYwhlILJ8h1vdDHLzBe43odBbtyMUNb+Ji8Cmf2kuLhOOJz8R4Tkgvh6VlMeLv3QR1u4ndQOpzuoI+pA=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:24:55.335726 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-fae5e505-524f-46eb-98f3-1b21bf384e93 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:24:55.340004 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-fae5e505-524f-46eb-98f3-1b21bf384e93 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:24:55.421645 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fae5e505-524f-46eb-98f3-1b21bf384e93 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105832 Jul 18 15:24:55.422292 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 579/1148] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Jul 18 15:24:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:24:57.686082 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1940139549", "imageRef": "287a3272-2d56-46c9-8606-523c7ba5808f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f02ced57-ea39-45d4-8716-b5d99e92419a"}], "security_groups": [{"name": "tempest-securitygroup--653909587"}], "key_name": "tempest-keypair-1464394003", "user_data": "}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:24:57.789474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.network.neutron [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] validate_networks() for [('f02ced57-ea39-45d4-8716-b5d99e92419a', None, None, None, None, None)] {{(pid=118339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 15:24:58.288009 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 15:24:58.288431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image limits 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 15:24:58.288905 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Flavor pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 15:24:58.289312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Image pref 0:0:0 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 15:24:58.289756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.virt.hardware [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 15:24:58.298945 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:58.300335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:58.300335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:58.300613 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:58.318225 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 15:24:58.322131 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.quota [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Getting quotas for user 5a9a938a9006499a9426af14cb182ecc and project 558c29b107e14e3f9b2aa041a388dfa4. Resources: {'ram', 'instances', 'cores'} {{(pid=118339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 15:24:58.333228 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Going to run 1 instances... {{(pid=118339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 15:24:58.335566 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='287a3272-2d56-46c9-8606-523c7ba5808f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 15:24:58.477724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-6be2c610-6294-4601-b4d1-9cb5da3751c6 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.796632 Jul 18 15:24:58.478387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 570/1149] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Jul 18 15:24:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 15:24:58.489404 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f2b6da92-b602-4583-b39d-62842b2ed2bb tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:58.490715 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f2b6da92-b602-4583-b39d-62842b2ed2bb tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:58.548120 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f2b6da92-b602-4583-b39d-62842b2ed2bb tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:58.555001 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f2b6da92-b602-4583-b39d-62842b2ed2bb tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1242 microversion: 2.1 time: 0.070268 Jul 18 15:24:58.555585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 580/1150] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:58 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:24:59.572819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:24:59.573689 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:24:59.581703 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:59.582158 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:59.582985 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:24:59.583447 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:24:59.654146 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:24:59.661999 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9a68b32c-2c03-4f21-a5a5-4616be1afcc8 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1246 microversion: 2.1 time: 0.093816 Jul 18 15:24:59.666521 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 571/1151] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:24:59 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:00.679667 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:00.680575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:00.687927 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:00.688494 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:00.689372 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:00.689827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:00.760684 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:00.769607 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7602765e-14f3-407e-b5a1-8d5295c972d4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1302 microversion: 2.1 time: 0.093826 Jul 18 15:25:00.770851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 581/1152] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:00 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:01.791962 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:01.794383 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:01.800265 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:01.803387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:01.803387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:01.803387 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:01.978129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:01.986839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ad0ba573-39f2-4d42-b564-ee318860a952 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1367 microversion: 2.1 time: 0.198754 Jul 18 15:25:01.987589 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 572/1153] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:01 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:02.364301 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-b787c345-b18c-4a33-8803-dd3cb2d7af73 req-7db42437-84d6-48e3-a7cc-5b28888f96c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f97f7a1-224e-4d2f-91e9-08b368b496ac", "tag": "6db480e3-1ffc-481a-9a4d-79eeafd9c0cb"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:02.373655 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b787c345-b18c-4a33-8803-dd3cb2d7af73 req-7db42437-84d6-48e3-a7cc-5b28888f96c4 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:02.374107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b787c345-b18c-4a33-8803-dd3cb2d7af73 req-7db42437-84d6-48e3-a7cc-5b28888f96c4 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:02.393739 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-b787c345-b18c-4a33-8803-dd3cb2d7af73 req-7db42437-84d6-48e3-a7cc-5b28888f96c4 service nova] Creating event network-changed:6db480e3-1ffc-481a-9a4d-79eeafd9c0cb for instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac on hv-cinder-83697 Jul 18 15:25:02.398913 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-b787c345-b18c-4a33-8803-dd3cb2d7af73 req-7db42437-84d6-48e3-a7cc-5b28888f96c4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038274 Jul 18 15:25:02.399587 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 582/1154] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:03.005242 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:03.006040 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:03.013426 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:03.013888 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:03.014794 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:03.015228 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:03.198181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:03.206186 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ff1ff616-3876-4019-8c2f-750cfea41773 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1367 microversion: 2.1 time: 0.205185 Jul 18 15:25:03.206881 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 573/1155] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:02 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:04.224750 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:04.231926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:04.232926 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:04.233161 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:04.233959 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:04.234407 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:04.368970 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:04.377245 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2c366c38-5aa0-4245-90a1-f89fb6cad767 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1367 microversion: 2.1 time: 0.157642 Jul 18 15:25:04.377840 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 583/1156] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:04 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:05.393819 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:05.394471 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:05.401107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:05.401637 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:05.402777 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:05.403223 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:05.544067 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:05.558519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-e4536bd4-1ea3-4159-91c7-9f7e31409c8a tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1367 microversion: 2.1 time: 0.161832 Jul 18 15:25:05.558519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 574/1157] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:05 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:06.218279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-56c6cc56-0c0a-47ca-a8c9-21b8d3f72732 req-03490e5b-3ede-41a3-9f98-a1be2b22095f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f97f7a1-224e-4d2f-91e9-08b368b496ac", "name": "network-vif-plugged", "status": "completed", "tag": "6db480e3-1ffc-481a-9a4d-79eeafd9c0cb"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:06.227117 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-56c6cc56-0c0a-47ca-a8c9-21b8d3f72732 req-03490e5b-3ede-41a3-9f98-a1be2b22095f service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:06.227566 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-56c6cc56-0c0a-47ca-a8c9-21b8d3f72732 req-03490e5b-3ede-41a3-9f98-a1be2b22095f service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:06.239631 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-56c6cc56-0c0a-47ca-a8c9-21b8d3f72732 req-03490e5b-3ede-41a3-9f98-a1be2b22095f service nova] Creating event network-vif-plugged:6db480e3-1ffc-481a-9a4d-79eeafd9c0cb for instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac on hv-cinder-83697 Jul 18 15:25:06.244637 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-56c6cc56-0c0a-47ca-a8c9-21b8d3f72732 req-03490e5b-3ede-41a3-9f98-a1be2b22095f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096587 Jul 18 15:25:06.245916 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 584/1158] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:06.569449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:06.570080 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:06.577565 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:06.578947 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:06.579769 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:06.580212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:06.722812 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:06.730878 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-2cf384e5-4260-4afa-a884-7db91d22fe41 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1367 microversion: 2.1 time: 0.165350 Jul 18 15:25:06.731460 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 575/1159] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:06 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:07.749302 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:07.750011 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:07.757152 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:07.757605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:07.758380 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:07.758845 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:07.892493 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:07.900147 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b34b71d5-a0f3-4885-9181-44c320c7de2f tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1367 microversion: 2.1 time: 0.155727 Jul 18 15:25:07.900728 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 585/1160] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:07 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:25:08.917989 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:08.918713 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:08.920995 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:08.922374 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell0:SELECT=6 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:08.928419 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:08.928885 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:08.929681 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:08.931137 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:09.076398 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:09.084729 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-4f2d8aca-3564-4048-ba49-78a22b23388c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1556 microversion: 2.1 time: 0.171447 Jul 18 15:25:09.085312 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 576/1161] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:08 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:09.102040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:09.103283 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:09.104874 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:09.110605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:09.111063 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:09.111851 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:09.112289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:09.197549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-041653d5-0d57-4c27-9f8f-44ea981a23a4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097710 Jul 18 15:25:09.197549 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 586/1162] 10.222.0.83 () {58 vars in 1274 bytes} [Mon Jul 18 15:25:09 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:10.315577 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-4f1f6d67-c8dd-4c94-9179-4c42332cdb21 req-dd8f08f6-607e-45cb-ab9e-8441e24d8765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f97f7a1-224e-4d2f-91e9-08b368b496ac", "tag": "6db480e3-1ffc-481a-9a4d-79eeafd9c0cb"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:10.319455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:10.324837 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-4f1f6d67-c8dd-4c94-9179-4c42332cdb21 req-dd8f08f6-607e-45cb-ab9e-8441e24d8765 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:10.328243 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-4f1f6d67-c8dd-4c94-9179-4c42332cdb21 req-dd8f08f6-607e-45cb-ab9e-8441e24d8765 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:10.329402 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:10.336818 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-4f1f6d67-c8dd-4c94-9179-4c42332cdb21 req-dd8f08f6-607e-45cb-ab9e-8441e24d8765 service nova] Creating event network-changed:6db480e3-1ffc-481a-9a4d-79eeafd9c0cb for instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac on hv-cinder-83697 Jul 18 15:25:10.344581 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-4f1f6d67-c8dd-4c94-9179-4c42332cdb21 req-dd8f08f6-607e-45cb-ab9e-8441e24d8765 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095348 Jul 18 15:25:10.345110 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 577/1163] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:22.311534 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:22.312798 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:22.316799 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:22.317307 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:22.320004 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-f7f3180e-13c9-4a01-ac5a-c20aedc1c286 req-2e0f117c-70ae-4dc1-80c8-ee7d19fbbfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3feb2f04-59a7-4448-8257-05e5a4a11339", "tag": "678d7454-42c1-4085-96bc-75e20add8cf4"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:22.327132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:22.327132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:22.327132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:22.327132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:22.332086 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-f7f3180e-13c9-4a01-ac5a-c20aedc1c286 req-2e0f117c-70ae-4dc1-80c8-ee7d19fbbfb7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:22.332530 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-f7f3180e-13c9-4a01-ac5a-c20aedc1c286 req-2e0f117c-70ae-4dc1-80c8-ee7d19fbbfb7 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:22.346739 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-f7f3180e-13c9-4a01-ac5a-c20aedc1c286 req-2e0f117c-70ae-4dc1-80c8-ee7d19fbbfb7 service nova] Creating event network-changed:678d7454-42c1-4085-96bc-75e20add8cf4 for instance 3feb2f04-59a7-4448-8257-05e5a4a11339 on hv-cinder-83697 Jul 18 15:25:22.352181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-f7f3180e-13c9-4a01-ac5a-c20aedc1c286 req-2e0f117c-70ae-4dc1-80c8-ee7d19fbbfb7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037648 Jul 18 15:25:22.353147 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 578/1164] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:22.353785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:25:22.642921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-18a38bf3-7a98-44c3-9e0b-6499e1c7d5fd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 204 len: 0 microversion: 2.1 time: 0.332500 Jul 18 15:25:22.646953 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 587/1165] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:25:22 2022] DELETE /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 15:25:22.653635 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:22.654354 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:22.666987 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:22.668107 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:22.668296 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:22.668639 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:22.819129 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:22.827923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-ef070839-b91c-4cce-84ee-17648628408e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1576 microversion: 2.1 time: 0.179541 Jul 18 15:25:22.828516 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 579/1166] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:22 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:25:23.847522 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:23.848242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:23.858214 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:23.858709 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:23.859513 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:23.860029 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:24.014386 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:24.022411 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54c51a62-2220-4662-a4ad-e91da5fcb2a8 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1576 microversion: 2.1 time: 0.180224 Jul 18 15:25:24.023141 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 588/1167] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:23 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 15:25:24.849479 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-95a1f15e-05aa-409b-879a-a348785858b5 req-fceb74c9-c69c-45d2-9d90-e16ae041e6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3feb2f04-59a7-4448-8257-05e5a4a11339", "name": "network-vif-deleted", "tag": "678d7454-42c1-4085-96bc-75e20add8cf4"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:24.859108 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-95a1f15e-05aa-409b-879a-a348785858b5 req-fceb74c9-c69c-45d2-9d90-e16ae041e6f9 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:24.859977 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-95a1f15e-05aa-409b-879a-a348785858b5 req-fceb74c9-c69c-45d2-9d90-e16ae041e6f9 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:24.871023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-95a1f15e-05aa-409b-879a-a348785858b5 req-fceb74c9-c69c-45d2-9d90-e16ae041e6f9 service nova] Creating event network-vif-deleted:678d7454-42c1-4085-96bc-75e20add8cf4 for instance 3feb2f04-59a7-4448-8257-05e5a4a11339 on hv-cinder-83697 Jul 18 15:25:24.876039 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-95a1f15e-05aa-409b-879a-a348785858b5 req-fceb74c9-c69c-45d2-9d90-e16ae041e6f9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030530 Jul 18 15:25:24.876651 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 580/1168] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:25.116943 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:25.117724 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:25.125363 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:25.125827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:25.126655 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:25.127107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:25.195114 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:25.202821 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e7d3bc26-7d28-4fda-a9ce-6ee051ee56f6 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 200 len: 1224 microversion: 2.1 time: 0.089783 Jul 18 15:25:25.203424 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 589/1169] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:25 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:26.222005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:26.222643 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 3feb2f04-59a7-4448-8257-05e5a4a11339] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:26.228974 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:26.229449 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:26.230223 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:26.230704 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:26.244056 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] HTTP exception thrown: Instance 3feb2f04-59a7-4448-8257-05e5a4a11339 could not be found. Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Request method failure captured: Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 HTTP/1.1 Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XmD8GDqu7iaLOtpykvryH3taVjUt4e86R4BCV4IW5kx8qszI_hGAT7G4-vgaYt8YBDl_UaSS9tiNtwCTriUGgQQRyV8IbyVqlSTmKpqjF-o-5QYHUx9pj5zq8glbTKz21zN_EM_7WKeLhF2DLO_4kzNv6KGANrS4-Thx5s2z0BfEiU Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:25:26.247154 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_94513773e0c94187bbdaeb82c7304eae", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 6bfa2a00688d4eab993059ff176d8920 Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 3feb2f04-59a7-4448-8257-05e5a4a11339 could not be found. Jul 18 15:25:26.248937 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '3feb2f04-59a7-4448-8257-05e5a4a11339'} Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3feb2f04-59a7-4448-8257-05e5a4a11339 could not be found. Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:25:26.249797 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3feb2f04-59a7-4448-8257-05e5a4a11339 could not be found. Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3feb2f04-59a7-4448-8257-05e5a4a11339 could not be found. Jul 18 15:25:26.251291 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:26.252552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Returning 404 to user: Instance 3feb2f04-59a7-4448-8257-05e5a4a11339 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:25:26.252552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-87c810f4-00f6-41fb-9f19-66657796a68f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339" status: 404 len: 111 microversion: 2.1 time: 0.030624 Jul 18 15:25:26.252552 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 581/1170] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:26 2022] GET /compute/v2.1/servers/3feb2f04-59a7-4448-8257-05e5a4a11339 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:25:30.028987 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:30.031349 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:30.032350 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-94a4ab25-7c99-43a5-80f0-0ecb7bdef37e req-d16fe20f-7de2-41a4-a9ab-f1db9c0cb96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6280155e-8c55-4a6f-a0a6-8c3dea47bf58", "tag": "f5a0dc2f-72ce-4f3f-808f-0c62de00f21d"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:30.037022 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:30.037489 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:30.038469 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:30.038957 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:30.044501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-94a4ab25-7c99-43a5-80f0-0ecb7bdef37e req-d16fe20f-7de2-41a4-a9ab-f1db9c0cb96c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:30.045492 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-94a4ab25-7c99-43a5-80f0-0ecb7bdef37e req-d16fe20f-7de2-41a4-a9ab-f1db9c0cb96c service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:30.061364 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-94a4ab25-7c99-43a5-80f0-0ecb7bdef37e req-d16fe20f-7de2-41a4-a9ab-f1db9c0cb96c service nova] Creating event network-changed:f5a0dc2f-72ce-4f3f-808f-0c62de00f21d for instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 on hv-cinder-83697 Jul 18 15:25:30.067181 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-94a4ab25-7c99-43a5-80f0-0ecb7bdef37e req-d16fe20f-7de2-41a4-a9ab-f1db9c0cb96c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039282 Jul 18 15:25:30.068279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 582/1171] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:30.070331 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:25:30.360988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9c2b625a-a56c-45eb-879e-7fb989b376dd tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 204 len: 0 microversion: 2.1 time: 0.335792 Jul 18 15:25:30.361962 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 590/1172] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:25:30 2022] DELETE /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:25:30.372815 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:30.375869 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:30.385005 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:30.385476 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:30.386286 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:30.386891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:30.536649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:30.545315 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-66f0064b-f9f5-4496-a3cc-b65b8f54939b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1577 microversion: 2.1 time: 0.178760 Jul 18 15:25:30.545901 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 583/1173] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:30 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:31.563969 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:31.564843 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:31.571617 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:31.572077 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:31.573575 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:31.574185 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:31.724154 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:31.732968 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0a1931af-f7e1-4754-9144-92b5e44b3e60 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1577 microversion: 2.1 time: 0.173455 Jul 18 15:25:31.733571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 591/1174] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:31 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:32.685176 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-05836cb3-9037-467b-8933-8583cc509040 req-c1cf258d-3e19-4d7b-80fc-fd329f781d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6280155e-8c55-4a6f-a0a6-8c3dea47bf58", "name": "network-vif-deleted", "tag": "f5a0dc2f-72ce-4f3f-808f-0c62de00f21d"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:32.694314 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-05836cb3-9037-467b-8933-8583cc509040 req-c1cf258d-3e19-4d7b-80fc-fd329f781d13 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:32.694807 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-05836cb3-9037-467b-8933-8583cc509040 req-c1cf258d-3e19-4d7b-80fc-fd329f781d13 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:32.706601 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-05836cb3-9037-467b-8933-8583cc509040 req-c1cf258d-3e19-4d7b-80fc-fd329f781d13 service nova] Creating event network-vif-deleted:f5a0dc2f-72ce-4f3f-808f-0c62de00f21d for instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 on hv-cinder-83697 Jul 18 15:25:32.711482 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-05836cb3-9037-467b-8933-8583cc509040 req-c1cf258d-3e19-4d7b-80fc-fd329f781d13 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030841 Jul 18 15:25:32.712490 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 584/1175] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:32.752461 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:32.752908 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:32.760818 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:32.761501 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:32.762288 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:32.762757 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:32.830040 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:32.839019 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4c63df04-b268-478a-bcfe-b2050471343f tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1391 microversion: 2.1 time: 0.092408 Jul 18 15:25:32.839700 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 592/1176] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:32 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:33.858615 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:33.859234 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:33.865894 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:33.869499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:33.869499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:33.869499 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:33.901839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:33.902287 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:33.902775 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.objects.instance [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lazy-loading 'fault' on Instance uuid 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 {{(pid=118339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:25:33.945735 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa2a00688d4eab993059ff176d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94513773e0c94187bbdaeb82c7304eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:33.953710 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-77b7a7ac-3e59-4988-86b0-e8707fa3954b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 200 len: 1183 microversion: 2.1 time: 0.100387 Jul 18 15:25:33.954289 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 585/1177] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:33 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 1183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:34.971279 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:34.972193 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 6280155e-8c55-4a6f-a0a6-8c3dea47bf58] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:34.979624 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:34.980079 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:34.980883 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:34.981327 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:34.998830 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] HTTP exception thrown: Instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 could not be found. Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Request method failure captured: Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 HTTP/1.1 Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XmD8GDqu7iaLOtpykvryH3taVjUt4e86R4BCV4IW5kx8qszI_hGAT7G4-vgaYt8YBDl_UaSS9tiNtwCTriUGgQQRyV8IbyVqlSTmKpqjF-o-5QYHUx9pj5zq8glbTKz21zN_EM_7WKeLhF2DLO_4kzNv6KGANrS4-Thx5s2z0BfEiU Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:25:35.000514 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_94513773e0c94187bbdaeb82c7304eae", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 6bfa2a00688d4eab993059ff176d8920 Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 could not be found. Jul 18 15:25:35.002122 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '6280155e-8c55-4a6f-a0a6-8c3dea47bf58'} Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 could not be found. Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:25:35.003050 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 could not be found. Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 could not be found. Jul 18 15:25:35.004742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.006172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Returning 404 to user: Instance 6280155e-8c55-4a6f-a0a6-8c3dea47bf58 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:25:35.006172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5b389e17-9555-4a84-b223-3e777a5da13e tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58" status: 404 len: 111 microversion: 2.1 time: 0.034598 Jul 18 15:25:35.006172 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 593/1178] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:34 2022] GET /compute/v2.1/servers/6280155e-8c55-4a6f-a0a6-8c3dea47bf58 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:25:35.583629 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:35.586186 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:35.591570 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:35.592020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:35.592809 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:35.593245 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:35.608102 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] HTTP exception thrown: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Request method failure captured: Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: DELETE /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be HTTP/1.1 Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XmD8GDqu7iaLOtpykvryH3taVjUt4e86R4BCV4IW5kx8qszI_hGAT7G4-vgaYt8YBDl_UaSS9tiNtwCTriUGgQQRyV8IbyVqlSTmKpqjF-o-5QYHUx9pj5zq8glbTKz21zN_EM_7WKeLhF2DLO_4kzNv6KGANrS4-Thx5s2z0BfEiU Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:25:35.609800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_94513773e0c94187bbdaeb82c7304eae", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 6bfa2a00688d4eab993059ff176d8920 Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.611865 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '0f0a0fa7-898e-4bdd-9a61-8ed362f942be'} Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:25:35.612860 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.614574 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.616203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Returning 404 to user: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:25:35.616203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-36b49afb-e864-4001-89b4-7a4f098578e3 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 404 len: 111 microversion: 2.1 time: 0.032089 Jul 18 15:25:35.616203 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 586/1179] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:25:35 2022] DELETE /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:25:35.621524 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:35.622144 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] [instance: 0f0a0fa7-898e-4bdd-9a61-8ed362f942be] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:35.628308 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:35.628790 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:35.629559 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:35.630002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:35.643850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] HTTP exception thrown: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Request method failure captured: Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be HTTP/1.1 Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XmD8GDqu7iaLOtpykvryH3taVjUt4e86R4BCV4IW5kx8qszI_hGAT7G4-vgaYt8YBDl_UaSS9tiNtwCTriUGgQQRyV8IbyVqlSTmKpqjF-o-5QYHUx9pj5zq8glbTKz21zN_EM_7WKeLhF2DLO_4kzNv6KGANrS4-Thx5s2z0BfEiU Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:25:35.645401 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_94513773e0c94187bbdaeb82c7304eae", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/94513773e0c94187bbdaeb82c7304eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 94513773e0c94187bbdaeb82c7304eae Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411060708 Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 6bfa2a00688d4eab993059ff176d8920 Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestVolumeBootPattern-1411060708-project Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.647129 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '0f0a0fa7-898e-4bdd-9a61-8ed362f942be'} Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:25:35.648064 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. Jul 18 15:25:35.649746 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:25:35.651827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Returning 404 to user: Instance 0f0a0fa7-898e-4bdd-9a61-8ed362f942be could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:25:35.651827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e27f0556-6689-4697-bdd9-d97386b18860 tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be" status: 404 len: 111 microversion: 2.1 time: 0.029609 Jul 18 15:25:35.651827 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 594/1180] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:35 2022] GET /compute/v2.1/servers/0f0a0fa7-898e-4bdd-9a61-8ed362f942be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:25:37.210033 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-7a2dded2-3b62-48f1-947f-e4bae15a087b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] Calling method '.version_select at 0x7f48c16e3c10>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:37.286673 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-7a2dded2-3b62-48f1-947f-e4bae15a087b tempest-TestVolumeBootPattern-1411060708 tempest-TestVolumeBootPattern-1411060708-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-577847118" status: 202 len: 0 microversion: 2.1 time: 0.080652 Jul 18 15:25:37.287335 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 587/1181] 10.222.0.83 () {58 vars in 1259 bytes} [Mon Jul 18 15:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-577847118 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:25:46.083597 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:46.084242 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:46.086713 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:46.087928 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:46.092802 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:46.093258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:46.094038 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:46.094475 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:46.118074 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-df8af767-13b5-473d-bb75-49f4a897ebed tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/ips" status: 200 len: 148 microversion: 2.1 time: 0.038358 Jul 18 15:25:46.119605 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 595/1182] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:25:46 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:47.804718 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_cell1:SELECT=33 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:47.805594 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG dbcounter [-] [118339] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 15:25:47.810055 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "741958eb-be4e-4454-b44f-1946e6f0afe8"}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:25:47.811185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:47.818226 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:47.818771 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:47.828407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:47.828407 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:48.638597 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c88614a8-535f-4688-ab1f-7f5751f2bbec tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "POST /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835213 Jul 18 15:25:48.639452 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 588/1183] 10.222.0.83 () {60 vars in 1322 bytes} [Mon Jul 18 15:25:47 2022] POST /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:56.248371 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:56.249795 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:56.256435 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:56.256897 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:56.257662 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:56.258097 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:56.341571 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lazy-loading 'services' on Instance uuid 0f97f7a1-224e-4d2f-91e9-08b368b496ac {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 15:25:56.492557 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0960dccc-2eb7-4c86-b518-dc8ec6da7a47 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments/741958eb-be4e-4454-b44f-1946e6f0afe8" status: 202 len: 0 microversion: 2.1 time: 0.249647 Jul 18 15:25:56.493198 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 596/1184] 10.222.0.83 () {58 vars in 1415 bytes} [Mon Jul 18 15:25:56 2022] DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments/741958eb-be4e-4454-b44f-1946e6f0afe8 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:25:56.504025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:56.505109 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:56.512353 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:56.512808 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:56.513585 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:56.514020 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:56.544155 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c0fac92b-9467-4268-bc37-82ba234317e7 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Jul 18 15:25:56.544730 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 589/1185] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:25:56 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:25:57.558309 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:57.559320 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:57.565646 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:57.566107 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:57.566921 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:57.567366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:57.598643 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-df46fda1-c0a0-420c-a8c9-a59237707a54 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045933 Jul 18 15:25:57.599216 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 597/1186] 10.222.0.83 () {58 vars in 1301 bytes} [Mon Jul 18 15:25:57 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 15:25:57.659708 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:57.660288 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:57.667450 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:57.667923 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:57.668711 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:57.669153 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:57.695363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Going to try to terminate instance {{(pid=118339) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 15:25:58.059366 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-bc42a4bd-a582-411a-8798-d4a6df7eeaa4 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 204 len: 0 microversion: 2.1 time: 0.403320 Jul 18 15:25:58.059972 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 590/1187] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:25:57 2022] DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 15:25:58.068644 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:58.069414 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:58.088017 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:58.088017 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:58.088017 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:58.088017 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:58.214730 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:58.222685 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2811d75e-3a38-4c2a-a6ea-9d9839ea6765 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1680 microversion: 2.1 time: 0.158091 Jul 18 15:25:58.223258 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 598/1188] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:58 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:25:59.241992 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:25:59.247844 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:25:59.250018 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:59.250473 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:59.251346 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:25:59.251794 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:25:59.394091 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.policy [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118339) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:25:59.402926 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-3c55cc40-498e-4296-8e53-76cf171a8374 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1680 microversion: 2.1 time: 0.165335 Jul 18 15:25:59.403518 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 591/1189] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:25:59 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:26:00.421974 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:00.422627 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:00.429285 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:00.429742 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:00.431319 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:00.431942 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:00.515585 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9a938a9006499a9426af14cb182ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558c29b107e14e3f9b2aa041a388dfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 15:26:00.523352 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9e4012d0-80b1-4620-8ccb-9764e05bae83 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 200 len: 1613 microversion: 2.1 time: 0.105340 Jul 18 15:26:00.523939 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 599/1190] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:26:00 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 1613 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 15:26:00.628868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [req-023a5b64-4a72-4bb9-9f3b-1f890ef721b0 req-da779a4f-4ea4-48b5-84bd-a74df1123d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f97f7a1-224e-4d2f-91e9-08b368b496ac", "name": "network-vif-deleted", "tag": "6db480e3-1ffc-481a-9a4d-79eeafd9c0cb"}]} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:26:00.639478 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-023a5b64-4a72-4bb9-9f3b-1f890ef721b0 req-da779a4f-4ea4-48b5-84bd-a74df1123d73 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:00.648248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [req-023a5b64-4a72-4bb9-9f3b-1f890ef721b0 req-da779a4f-4ea4-48b5-84bd-a74df1123d73 service nova] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:00.654051 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.compute.server_external_events [req-023a5b64-4a72-4bb9-9f3b-1f890ef721b0 req-da779a4f-4ea4-48b5-84bd-a74df1123d73 service nova] Creating event network-vif-deleted:6db480e3-1ffc-481a-9a4d-79eeafd9c0cb for instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac on hv-cinder-83697 Jul 18 15:26:00.659569 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [req-023a5b64-4a72-4bb9-9f3b-1f890ef721b0 req-da779a4f-4ea4-48b5-84bd-a74df1123d73 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034459 Jul 18 15:26:00.660164 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 592/1191] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Jul 18 15:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 15:26:01.540423 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:01.543602 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:01.549221 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:01.549652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:01.550613 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:01.551066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:01.566023 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac HTTP/1.1 Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:01.567938 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:01.569734 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '0f97f7a1-224e-4d2f-91e9-08b368b496ac'} Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:01.570652 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:01.573204 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:01.574696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:01.574696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-810848e5-8246-41c0-99d1-665b8adac8c3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 404 len: 111 microversion: 2.1 time: 0.033110 Jul 18 15:26:01.574696 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 600/1192] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:26:01 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:01.579756 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9e99c1f4-2db9-46f1-abcc-d82443e1f1d3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '.version_select at 0x7f48c3e5ca60>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:01.669318 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9e99c1f4-2db9-46f1-abcc-d82443e1f1d3 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464394003" status: 202 len: 0 microversion: 2.1 time: 0.093788 Jul 18 15:26:01.670316 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 593/1193] 10.222.0.83 () {58 vars in 1220 bytes} [Mon Jul 18 15:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464394003 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 15:26:03.755994 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:03.756530 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:03.763200 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:03.763654 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:03.764431 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:03.764866 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:03.778517 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac HTTP/1.1 Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:03.780132 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.781785 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '0f97f7a1-224e-4d2f-91e9-08b368b496ac'} Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:03.782863 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.784400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.786070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:03.786070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-68084a0e-25eb-4777-97e4-e8c7ab1af5b5 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 404 len: 111 microversion: 2.1 time: 0.029432 Jul 18 15:26:03.786070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 601/1194] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:26:03 2022] DELETE /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:03.792058 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:03.792832 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0f97f7a1-224e-4d2f-91e9-08b368b496ac] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:03.802235 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:03.802724 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:03.803513 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:03.803951 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:03.818316 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac HTTP/1.1 Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:03.820015 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.822298 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '0f97f7a1-224e-4d2f-91e9-08b368b496ac'} Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:03.824365 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. Jul 18 15:26:03.825874 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:03.827351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 0f97f7a1-224e-4d2f-91e9-08b368b496ac could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:03.827351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-a1be1e38-cfee-492b-bebc-7b2cefcb8313 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac" status: 404 len: 111 microversion: 2.1 time: 0.035026 Jul 18 15:26:03.827351 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 594/1195] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:26:03 2022] GET /compute/v2.1/servers/0f97f7a1-224e-4d2f-91e9-08b368b496ac => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:05.144450 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:05.144980 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:05.151763 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.152223 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.153008 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.153454 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.166973 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 HTTP/1.1 Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:05.168569 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.170299 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '82f397bb-a27c-4951-b40d-745f5ecd0c63'} Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:05.171289 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.172850 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.174413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:05.174413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6b7ec1b0-f78f-4d21-a9b1-00d72d143655 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 404 len: 111 microversion: 2.1 time: 0.029486 Jul 18 15:26:05.174413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 602/1196] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:26:05 2022] DELETE /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:05.178896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:05.179625 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 82f397bb-a27c-4951-b40d-745f5ecd0c63] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:05.187023 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.187519 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.188280 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.188721 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.202913 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 HTTP/1.1 Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:05.204467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.206173 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '82f397bb-a27c-4951-b40d-745f5ecd0c63'} Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:05.207162 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. Jul 18 15:26:05.208715 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.210134 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 82f397bb-a27c-4951-b40d-745f5ecd0c63 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:05.210134 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-144dd4af-31d9-4a2a-a1c0-56c10dc3d799 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63" status: 404 len: 111 microversion: 2.1 time: 0.031014 Jul 18 15:26:05.210134 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 595/1197] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:26:05 2022] GET /compute/v2.1/servers/82f397bb-a27c-4951-b40d-745f5ecd0c63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:05.214786 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:05.215339 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:05.222213 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.223053 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.223656 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.224096 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.238265 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 HTTP/1.1 Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:05.239860 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.241760 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '0519e1a5-8427-417a-afb3-981c4819be87'} Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:05.243804 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.250725 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.252366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:05.252366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-df634489-2631-4570-baeb-ebb9dcd28778 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 404 len: 111 microversion: 2.1 time: 0.030537 Jul 18 15:26:05.252366 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 603/1198] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:26:05 2022] DELETE /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:05.256248 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:05.256868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 0519e1a5-8427-417a-afb3-981c4819be87] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:05.263206 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.263657 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.264422 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:05.264868 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:05.279113 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 HTTP/1.1 Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:05.280678 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.282461 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '0519e1a5-8427-417a-afb3-981c4819be87'} Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:05.283431 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. Jul 18 15:26:05.285000 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:05.286400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 0519e1a5-8427-417a-afb3-981c4819be87 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:05.286400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-17e5b2ff-a3e7-4f9a-a033-6836ad5578b9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87" status: 404 len: 111 microversion: 2.1 time: 0.029820 Jul 18 15:26:05.286400 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 596/1199] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:26:05 2022] GET /compute/v2.1/servers/0519e1a5-8427-417a-afb3-981c4819be87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:06.600972 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:06.601488 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:06.608690 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:06.609140 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:06.609911 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:06.610354 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:06.625920 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 HTTP/1.1 Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:06.627578 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: > Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.629297 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '21494892-e0fd-4cd0-b274-4303d90e7817'} Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:06.630465 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.632066 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.634413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:06.634413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c7646bd-8fbc-4921-96a3-16cb8ed49cb9 tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 404 len: 111 microversion: 2.1 time: 0.031991 Jul 18 15:26:06.634413 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 604/1200] 10.222.0.83 () {58 vars in 1238 bytes} [Mon Jul 18 15:26:06 2022] DELETE /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:06.638480 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Calling method '>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:06.639135 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.compute.api [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] [instance: 21494892-e0fd-4cd0-b274-4303d90e7817] Fetching instance by UUID {{(pid=118339) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 15:26:06.645672 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:06.646128 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:06.646939 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 15:26:06.647381 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG oslo_concurrency.lockutils [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Lock "ac9e3721-a803-4db4-873c-e4d171be63cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 15:26:06.661212 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] HTTP exception thrown: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Request method failure captured: Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 HTTP/1.1 Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1Xps3SUi4eyycsqnpm4V9U6dh4wT8Atmm69XMuD1lJEpSG6sqp8__hPi0Cj_QVk6C3170TC6N9zkWJzWZIDnMPm4BDMNR3f-Mj2KOvNnLFB38-OwzIZ-SY7VasdUjDUaWJ7SzoT05j5lFyvXSoRUA-5NfA9D1axCUfItr7gUxhTRovU Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:06.662800 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_558c29b107e14e3f9b2aa041a388dfa4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/558c29b107e14e3f9b2aa041a388dfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: 558c29b107e14e3f9b2aa041a388dfa4 Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513143875 Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: 5a9a938a9006499a9426af14cb182ecc Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-AttachVolumeNegativeTest-513143875-project Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: > Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.664501 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': '21494892-e0fd-4cd0-b274-4303d90e7817'} Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:06.665839 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. Jul 18 15:26:06.667496 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:06.669025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] Returning 404 to user: Instance 21494892-e0fd-4cd0-b274-4303d90e7817 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:06.669025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-388b6b98-8e36-49e2-81db-6610e784139c tempest-AttachVolumeNegativeTest-513143875 tempest-AttachVolumeNegativeTest-513143875-project] 10.222.0.83 "GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817" status: 404 len: 111 microversion: 2.1 time: 0.029752 Jul 18 15:26:06.669025 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 597/1201] 10.222.0.83 () {58 vars in 1235 bytes} [Mon Jul 18 15:26:06 2022] GET /compute/v2.1/servers/21494892-e0fd-4cd0-b274-4303d90e7817 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:12.418621 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c265001-3e82-4077-953c-a27251f348b0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Action: 'create', calling method: .version_select at 0x7f48c1db2670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1396080223", "metadata": {"Type": "work"}}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c265001-3e82-4077-953c-a27251f348b0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Request method failure captured: Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 122 Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XuUwWeiRbWOiQHkdDOIpiCUZ_WMN8UGY2aE3EkDaYNQIn0fn2QUlcgBd8is9ZRYGtaDoU-5XmXlmcqSDOCL89jNH0BME4baHsxtV6oM_8-HTSgtHV5k_I61hFYwwZWi37Sugx3SRsBt_x_ppK7Qd7hi1sYzeP50WhpV23WAz51Nvpc Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:12.459305 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c0ecebd983324ead82b4fe7a86583e3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: cd1a25c255244bbca89a0dc8689b1915 Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1396080223", "metadata": {"Type": "work"}}} Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:26:12.461373 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1396080223', 'metadata': {'Type': 'work'}}}} Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise error Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:12.462706 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 15:26:12.464661 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 15:26:12.466521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 15:26:12.466521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.466521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c265001-3e82-4077-953c-a27251f348b0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:12.466521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2c265001-3e82-4077-953c-a27251f348b0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.157597 Jul 18 15:26:12.466521 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 605/1202] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Jul 18 15:26:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:26:12.470968 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9c9ff365-7269-4062-9762-086255400e4d tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Action: 'create', calling method: .version_select at 0x7f48c16e33a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1891462303", "metadata": {"Type": "work"}}} {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9c9ff365-7269-4062-9762-086255400e4d tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Request method failure captured: Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 120 Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XuUwWeiRbWOiQHkdDOIpiCUZ_WMN8UGY2aE3EkDaYNQIn0fn2QUlcgBd8is9ZRYGtaDoU-5XmXlmcqSDOCL89jNH0BME4baHsxtV6oM_8-HTSgtHV5k_I61hFYwwZWi37Sugx3SRsBt_x_ppK7Qd7hi1sYzeP50WhpV23WAz51Nvpc Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:12.474455 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c0ecebd983324ead82b4fe7a86583e3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: cd1a25c255244bbca89a0dc8689b1915 Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1891462303", "metadata": {"Type": "work"}}} Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: Jul 18 15:26:12.476215 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1891462303', 'metadata': {'Type': 'work'}}}} Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise error Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi '0' Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:12.477451 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 15:26:12.479371 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 15:26:12.481104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 15:26:12.481104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.481104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-9c9ff365-7269-4062-9762-086255400e4d tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:12.481104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-9c9ff365-7269-4062-9762-086255400e4d tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008893 Jul 18 15:26:12.481104 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 598/1203] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Jul 18 15:26:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 15:26:12.485346 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-95ced097-4ab8-4868-9854-69ae8b8f6d56 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Action: 'create', calling method: .version_select at 0x7f48c1f315e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953255321", "metadata": {"Type": "work"}}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-95ced097-4ab8-4868-9854-69ae8b8f6d56 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Request method failure captured: Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 118 Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XuUwWeiRbWOiQHkdDOIpiCUZ_WMN8UGY2aE3EkDaYNQIn0fn2QUlcgBd8is9ZRYGtaDoU-5XmXlmcqSDOCL89jNH0BME4baHsxtV6oM_8-HTSgtHV5k_I61hFYwwZWi37Sugx3SRsBt_x_ppK7Qd7hi1sYzeP50WhpV23WAz51Nvpc Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:12.487722 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c0ecebd983324ead82b4fe7a86583e3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: cd1a25c255244bbca89a0dc8689b1915 Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953255321", "metadata": {"Type": "work"}}} Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:26:12.489385 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-953255321', 'metadata': {'Type': 'work'}}}} Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise error Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi '' Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:12.490731 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 15:26:12.493119 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 15:26:12.494889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 15:26:12.494889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.494889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-95ced097-4ab8-4868-9854-69ae8b8f6d56 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:12.494889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-95ced097-4ab8-4868-9854-69ae8b8f6d56 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007768 Jul 18 15:26:12.494889 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 606/1204] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Jul 18 15:26:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 15:26:12.498811 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c4319810-b6ab-482e-bf53-65a13e6ea71f tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Calling method '.version_select at 0x7f48c1937940>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:12.530933 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-c4319810-b6ab-482e-bf53-65a13e6ea71f tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] HTTP exception thrown: Volume tempest-invalid-437655838 could not be found. Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c4319810-b6ab-482e-bf53-65a13e6ea71f tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Request method failure captured: Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-437655838 HTTP/1.1 Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XuUwWeiRbWOiQHkdDOIpiCUZ_WMN8UGY2aE3EkDaYNQIn0fn2QUlcgBd8is9ZRYGtaDoU-5XmXlmcqSDOCL89jNH0BME4baHsxtV6oM_8-HTSgtHV5k_I61hFYwwZWi37Sugx3SRsBt_x_ppK7Qd7hi1sYzeP50WhpV23WAz51Nvpc Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:12.532963 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c0ecebd983324ead82b4fe7a86583e3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: cd1a25c255244bbca89a0dc8689b1915 Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Volume tempest-invalid-437655838 could not be found. Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': 'tempest-invalid-437655838'} Jul 18 15:26:12.534649 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-437655838 could not be found. (HTTP 404) (Request-ID: req-59bd478d-3726-4d31-a2aa-4cbbd827d884) Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.538717 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 15:26:12.540369 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-437655838 could not be found. Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:12.541896 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-437655838 could not be found. Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-437655838 could not be found. Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-c4319810-b6ab-482e-bf53-65a13e6ea71f tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Returning 404 to user: Volume tempest-invalid-437655838 could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-c4319810-b6ab-482e-bf53-65a13e6ea71f tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-437655838" status: 404 len: 98 microversion: 2.1 time: 0.039387 Jul 18 15:26:12.543550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 599/1205] 10.222.0.83 () {58 vars in 1214 bytes} [Mon Jul 18 15:26:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-437655838 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 15:26:12.546224 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-979396e6-5a6c-44fa-bb6a-4d678557e778 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005120 Jul 18 15:26:12.546753 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 607/1206] 10.222.0.83 () {58 vars in 1139 bytes} [Mon Jul 18 15:26:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 15:26:12.555846 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-0cff77c3-1faa-4399-ab99-cf90af9d6589 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004327 Jul 18 15:26:12.556279 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 600/1207] 10.222.0.83 () {58 vars in 1136 bytes} [Mon Jul 18 15:26:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 15:26:12.565002 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-da5d40aa-09a6-4a1e-a5ad-8c6129b6d670 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Calling method '.version_select at 0x7f48c1e84dc0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:12.594454 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-da5d40aa-09a6-4a1e-a5ad-8c6129b6d670 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] HTTP exception thrown: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-da5d40aa-09a6-4a1e-a5ad-8c6129b6d670 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Request method failure captured: Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/os-volumes/7fc51a1a-fa48-4db7-96d7-f3db6542f840 HTTP/1.1 Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Connection: close Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Host: 10.222.0.83 Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi1XuUwWeiRbWOiQHkdDOIpiCUZ_WMN8UGY2aE3EkDaYNQIn0fn2QUlcgBd8is9ZRYGtaDoU-5XmXlmcqSDOCL89jNH0BME4baHsxtV6oM_8-HTSgtHV5k_I61hFYwwZWi37Sugx3SRsBt_x_ppK7Qd7hi1sYzeP50WhpV23WAz51Nvpc Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Role: reader,member Jul 18 15:26:12.596758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Roles: reader,member Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c0ecebd983324ead82b4fe7a86583e3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Id: cd1a25c255244bbca89a0dc8689b1915 Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: method: Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: exception: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: action_args: {'id': '7fc51a1a-fa48-4db7-96d7-f3db6542f840'} Jul 18 15:26:12.598456 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. (HTTP 404) (Request-ID: req-16b98cbf-5bfd-4459-a166-26f6098cc8ff) Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.599552 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 15:26:12.601085 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 15:26:12.602992 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-da5d40aa-09a6-4a1e-a5ad-8c6129b6d670 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Returning 404 to user: Volume 7fc51a1a-fa48-4db7-96d7-f3db6542f840 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-da5d40aa-09a6-4a1e-a5ad-8c6129b6d670 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/7fc51a1a-fa48-4db7-96d7-f3db6542f840" status: 404 len: 109 microversion: 2.1 time: 0.036890 Jul 18 15:26:12.604515 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 608/1208] 10.222.0.83 () {58 vars in 1247 bytes} [Mon Jul 18 15:26:12 2022] DELETE /compute/v2.1/os-volumes/7fc51a1a-fa48-4db7-96d7-f3db6542f840 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:26:12.610891 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d8382b54-03c3-4424-8774-69705a7bdcb0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Calling method '.version_select at 0x7f48c1877670>' {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 15:26:12.639489 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.wsgi [None req-d8382b54-03c3-4424-8774-69705a7bdcb0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] HTTP exception thrown: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d8382b54-03c3-4424-8774-69705a7bdcb0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Request method failure captured: Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: request: GET /compute/v2.1/os-volumes/e9643fa8-833c-482e-a3f7-a45ca3f2fb8d HTTP/1.1 Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept: application/json Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Accept-Encoding: identity Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Connection: close Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Length: 0 Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Content-Type: application/json Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Host: 10.222.0.83 Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Openstack-System-Scope: None Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: User-Agent: python-urllib3/1.26.9 Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Auth-Token: gAAAAABi1XuUwWeiRbWOiQHkdDOIpiCUZ_WMN8UGY2aE3EkDaYNQIn0fn2QUlcgBd8is9ZRYGtaDoU-5XmXlmcqSDOCL89jNH0BME4baHsxtV6oM_8-HTSgtHV5k_I61hFYwwZWi37Sugx3SRsBt_x_ppK7Qd7hi1sYzeP50WhpV23WAz51Nvpc Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Id: None Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Domain-Name: None Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Identity-Status: Confirmed Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Is-Admin-Project: True Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Id: default Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Domain-Name: Default Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Project-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Role: reader,member Jul 18 15:26:12.641502 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Roles: reader,member Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c0ecebd983324ead82b4fe7a86583e3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c0ecebd983324ead82b4fe7a86583e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}] Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Id: c0ecebd983324ead82b4fe7a86583e3a Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-Tenant-Name: tempest-VolumesNegativeTest-2145740777 Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Id: default Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Domain-Name: Default Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Id: cd1a25c255244bbca89a0dc8689b1915 Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: X-User-Name: tempest-VolumesNegativeTest-2145740777-project Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: method: Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: exception: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: action_args: {'id': 'e9643fa8-833c-482e-a3f7-a45ca3f2fb8d'} Jul 18 15:26:12.643185 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: {{(pid=118339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. (HTTP 404) (Request-ID: req-65b0b619-a410-445e-81b7-7ea9e1d531b5) Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.644202 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 15:26:12.645748 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 15:26:12.647550 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: ERROR nova.api.openstack.wsgi Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: DEBUG nova.api.openstack.wsgi [None req-d8382b54-03c3-4424-8774-69705a7bdcb0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] Returning 404 to user: Volume e9643fa8-833c-482e-a3f7-a45ca3f2fb8d could not be found. {{(pid=118339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO nova.api.openstack.requestlog [None req-d8382b54-03c3-4424-8774-69705a7bdcb0 tempest-VolumesNegativeTest-2145740777 tempest-VolumesNegativeTest-2145740777-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/e9643fa8-833c-482e-a3f7-a45ca3f2fb8d" status: 404 len: 109 microversion: 2.1 time: 0.036006 Jul 18 15:26:12.649593 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: [pid: 118339|app: 0|req: 601/1209] 10.222.0.83 () {58 vars in 1244 bytes} [Mon Jul 18 15:26:12 2022] GET /compute/v2.1/os-volumes/e9643fa8-833c-482e-a3f7-a45ca3f2fb8d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 15:27:07.899806 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:27:07.901070 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Mon Jul 18 15:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:27:40.224758 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:27:40.225539 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Mon Jul 18 15:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:29:04.967363 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:29:04.967965 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:29:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:29:07.129409 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:29:07.130062 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Mon Jul 18 15:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:30:27.909658 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:30:27.910347 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Mon Jul 18 15:30:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:30:30.785474 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:30:30.786088 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:30:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:31:00.233337 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:31:00.233986 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Mon Jul 18 15:31:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:31:58.541973 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:31:58.542766 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:32:24.976467 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:32:24.977121 dv-cinder-836973-13-iscsi devstack@n-api.service[118339]: Mon Jul 18 15:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 15:32:27.139400 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 15:32:27.139988 dv-cinder-836973-13-iscsi devstack@n-api.service[118340]: Mon Jul 18 15:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!